Skip to main content

7 posts tagged with "Superset"

View All Tags

Enterprise Enhancements to Apache Superset™

· One min read
Aidan Mulgrew
Software Engineer

Integration with Apache Superset’s ™ New Alert and Report System

· One min read
Aidan Mulgrew
Software Engineer

With the release of Apache Superset ™ 4.0, a new Alerts and Reports framework was introduced, replacing the previous reporting mechanisms. To ensure full compatibility, Millersoft reimplemented our enhancements, including the S3 delivery option and custom email body support, within this new framework. The updates extend the base notification class used by Superset’s core notification methods, ensuring that our improvements remain upgrade-safe and consistent with Superset’s architecture.

To access the new features, users simply select “Alerts & Reports” from the Superset settings menu, where they’ll find the additional configuration options for S3 delivery and enhanced email fields.


Apache Superset™ AWS S3 Integration for Report Delivery

· One min read
Aidan Mulgrew
Software Engineer

Millersoft as added AWS S3 as a new notification and delivery method for Apache Superset’s™ reporting system. While Superset natively supports Email and Slack, our enhancement allows users to additionally export and deliver reports directly to S3. This provides a convenient and secure way to integrate reports into external systems or make them accessible via an SFTP server.

S3 Export Example

This functionality is built as a new S3 notification plugin, extending Superset’s base notification framework. It’s fully integrated into the Superset UI, meaning users can simply select S3 as a delivery option directly from the Alerts & Reports configuration screen.


Apache Superset™ Enhanced Email Capabilities for CC, BCC and body

· One min read
Aidan Mulgrew
Software Engineer

In early versions Superset’s email reporting capabilities were relatively limited, typically supporting only basic recipient and subject fields.

Millersoft expanded this functionality significantly by adding CC and BCC fields for broader communication flexibilit. Superset now supports a custom email body, allowing teams to tailor their message content beyond the standard “Explore in Superset” link.

Enhanced Email Reporting

Enterprise ready Apache Superset™ authentication with Keycloak

· One min read
Aidan Mulgrew
Software Engineer

Millersoft has integrated Keycloak authentication, enabling teams to manage user access through a central identity provider. This integration supports enterprise requirements like single sign-on (SSO), role-based access control (RBAC), and multi-factor authentication. Enabling organisations to manage Superset users securely and at scale.


Smarter Apache Superset PII Data Handling with Tokenisation and Detokenisation

· One min read
Aidan Mulgrew
Software Engineer

To make sensitive data handling both secure and user-friendly within Superset, Millersoft introduced a new Detokenisation feature. This is available in both SQL Lab and the charting interface, which allows users to view tokenised data in a more readable format.

When enabled, this feature manipulates the returned dataframe to replace tokens (marked with a prefix like t:) with their plaintext values, which makes data exploration and analysis more intuitive for users who have permission.

This new feature balances data security with ease of analysis, ensuring that tokenised values can be revealed only when needed. These PII values are only visible for authorised users.

Unlocking the Power of Druid MSQ in Superset

· 3 min read
Aidan Mulgrew
Software Engineer

At Millersoft, we’ve been working to make Apache Druid™ more efficient, flexible, and cost-effective for analytics workloads. One area we’ve focused on is the Python-to-Druid connector (pydruid), which powers integrations with Apache Superset™.

We’re excited to share some improvements we’ve made that open the door to new capabilities in Superset dashboards and the potential for substantial cost savings in large-scale Druid deployments.


What We've Done

We extended the pydruid connector to support Druid’s MSQ (Multi-Stage Query) engine, which means Superset dashboards and charts can now use the MSQ engine. In addition, Superset can finally cancel running Druid queries, preventing wasted resources and speeding up the user experience.

These enhancements make Superset more responsive for analysts and more efficient for operators.


Why MSQ Is a Game-Changer

Traditionally, Druid queries rely heavily on historical nodes that keep data loaded on disk. While this ensures speed, it can be expensive to maintain, especially as data volumes grow.

The MSQ engine changes that. Now:

  • It can query directly against deep storage, removing the need to keep all historical data on disk.
  • Organizations can keep only recent hot data (e.g., the last 90 days) on historical nodes.
  • Older data can remain cost-effectively stored in deep storage, only queried on demand.

The Cost-Saving Opportunity

This hybrid model allows companies to reduce the number and size of historical nodes they need to operate.

For example:

  • Keep only 90 days of hot data in historicals.
  • Use MSQ to query older data in deep storage when needed.
  • Scale down historical nodes from multiple larger instances to fewer, smaller ones.

Depending on data volumes, this strategy could save thousands of dollars per month in infrastructure costs - all while retaining complete access to historical data.


A Better Experience in Superset

From the end-user’s perspective, the improvements are seamless:

  • Dashboards and charts remain fast and interactive for recent data.
  • Long-term analytics can still be run when needed, without bloating infrastructure.
  • Analysts can cancel queries directly from Superset, saving time and frustration.

This makes Superset not just a visualization tool, but also a cost-conscious analytics platform that adapts to both business and technical needs.


Looking Ahead

The combination of Superset’s flexibility and Druid’s MSQ engine gives organizations a new way to balance performance, cost, and data accessibility.

By making MSQ a first-class citizen in Superset through our pydruid improvements, we’re helping teams:

  • Deliver fast, interactive dashboards.
  • Keep full access to long-tail historical data.
  • Reduce infrastructure costs by optimizing their Druid footprint.

In other words: do more with less, without sacrificing depth of insight.