At Blendata, we continuously enhance our platform to provide a seamless and efficient data experience. Our latest updates bring new features that improve authentication, data management, monitoring, and workflow efficiency. Here’s a breakdown of what’s new and how these improvements benefit you.
GenAI SQL Generator with Blendata Assistant
Struggling with SQL queries? Blendata Assistant* now includes an SQL Generator that works similar to GenAI in helping users write queries with natural language inputs. Simply describe what you need, and the assistant will generate the SQL query for you.
*Additional fee may apply for Blendata Assistant license.
Authentication Integration
Enhanced Authentication with Third-Party Support
To improve security and convenience, our platform now supports third-party authentication, including Microsoft AD FS and Azure. This integration allows for a smoother login experience and stronger authentication measures.
Personal Access Token Settings
Each user can now manage their own access tokens through a dedicated settings page. Key functionalities include:
- Setting expiration periods (lifetime settings).
- Activating or deactivating tokens.
- Creating multiple personal tokens.
- Deleting access tokens when no longer needed.
Data Ingestion
Delta Table Creation in Data Catalog
Users can now create schemas for Delta assets and configure compaction and vacuum services for Delta tables, improving data organization and maintenance.
Import & Aggregate Data into Existing Tables
We’ve made data importing even more flexible! Now, users can:
- Import data directly into existing tables without needing to create a new schema.
- Choose from three upload methods: One-time, Scheduled, and Streaming.
Limitations:
- Import services (such as Table Update, Stream, and Aggregate), service chain, and Workflow service are not supported.
- If a user creates a new import or aggregate service after performing an import or aggregation into an existing table, the new import service may not function as expected.
- Tables created before version 4.6.0 with encryption settings cannot use the append mode.
- Users must have ‘Edit’ permissions for the selected data asset.
Expanding State Table Capability
Our state table functionality now extends beyond streaming imports to support scheduled and one-time uploads. This enables users to manage data storage locations more efficiently for time-series data.
Limitations:
- This feature is only available for time-series data.
- Source type, schema, time-domain, partition, and encryption settings cannot be changed once set.
Seamless Databricks Data Integration
Databricks is a widely recognized and trusted platform in the big data industry, used by businesses around the world to manage and analyze large amounts of data. To make data integration even more seamless, we have introduced a new feature that allows users to easily bring data from Databricks into our platform.
With this capability, businesses can effortlessly transfer their Databricks data for further processing and analysis, unlocking valuable insights and enhancing decision-making—without the need for complex technical steps.
Data Management
Compute Task Monitoring Made Simple
Our new compute task monitoring feature provides visibility into Spark jobs (Zeus) via the Blendata user interface. Users can now track their data query and export tasks, cancel jobs if needed, and see job queues and progress status, helping to optimize resource allocation.
Note: This feature currently excludes Zeppelin jobs (Jobs in Notebook).
Data Lineage for Workflow
A new Workflow menu has been added to Data Lineage, allowing users to:
- Visualize workflow streams.
- Quickly access their workflows directly from the menu.
The Workflow upstream will be displayed when users have previously utilized the SQL service.
Improved Data Organization: Distribute Data Assets Across Multiple Database Schemas
Data assets can now be categorized based on roles or users, making access management more efficient and reducing admin workload. This feature will help reduce the time required for administrators to assign access to individual assets for each user.
Asset Owner Transfer for Better Management
Admins (Administrator role only) can now transfer ownership of all assets—including data assets, services, service chains, and workflows—across all Realms. This simplifies management and reassignment when needed.
System Table Retention Policy: Minimum 90 Days*
System table retention now has a minimum period of 90 days, ensuring compliance with NECTEC standards while maintaining data history.
*This feature will only apply to Blendata enterprise: Log management edition. Please seek out your product representative for more information.
Service Monitoring for Better Visibility
The new Service Monitoring menu enables users to:
- Filter job status based on time periods (minutes or hours).
- View active and queued service jobs.
- Track job statuses such as Error, Incomplete, or Skipped.
Note: This feature must be enabled via role or user management.
Data Processing and Analytics
New Service Type: Import Service in Workflow
Users can now streamline data import by integrating Import Service Jobs into the Workflow Management menu. This simplifies the process of adding new data assets or updating existing ones.
Importing Libraries in Notebook Environment
Users can now directly import libraries into their Notebook environment by:
- Uploading or moving files to the python_scripts folder.
- Running import filename within the Notebook.
Note: Currently supports Python interpreter (%python) only.
Role-Based Zeus Allocation
To prevent resource conflicts and optimize system performance, Zeus resources can now be allocated specifically for different roles.
Error Identification with Unique Error IDs
We have introduced unique error IDs in logs to help users quickly identify and troubleshoot issues.
Others
Automated Database Migration
We have optimized the platform’s initial database setup with a script-driven approach, enhancing flexibility for future database management. This improvement also streamlines integration with container-based environments, ensuring greater scalability and efficiency.
Limitation: Users must first upgrade to version 4.5.x before migrating to version 4.6.0.
These updates are designed to make your data experience with Blendata more secure, efficient, and user-friendly. If you have any questions or need assistance, feel free to reach out to our support team. Stay tuned for more exciting updates!
