December 2024 changelog🔗
Here you'll find the December 2024 changelog for the Data Productivity Cloud. Just want to read about new features? Read our New Features blog.
12th December🔗
DesignerNew features 🎉
- Added the
Retrieve Runendpoint to the dbt Cloud Flex connector.
AgentImprovements 🔧
- The agent template for Azure now deploys with an environment type of "Workload profile - Dedicated" (was previously "Consumption Only"). This allows the agent to better facilitate complex networking, while keeping the ability for the agent to auto-update.
9th December🔗
CDC
- Updated the CDC agent version from
2.98.7to2.101.2. - For customers who may have experienced an out-of-memory issue with the agent, we have added a new advanced property
matillion.compact-historythat can be set totruein any affected pipeline definition. This will reduce the memory footprint of the agent by compacting the schema history of the pipeline. - For pipelines that stream data directly to Snowflake, the agent will create a new column
MTLN_CDC_LOAD_TIMESTAMPin each target table to store the load timestamp of each row. - Library updates and security fixes.
6th December🔗
APINew Endpoints 🎉
The following endpoints have been added to the Data Productivity Cloud REST API:
Credit consumption
| Method | Endpoint | Description |
|---|---|---|
| GET | /v1/consumption | Get a breakdown of your credit consumption for flat-rated products |
| GET | /v1/consumption/etl-users | Get a breakdown of your credit consumption for ETL users |
5th December🔗
DesignerNew features 🎉
- Added the new Skip on run action to the component action bar. This allows you to temporarily disable a component in a pipeline, without removing it. For more information, read Skip components.
New transformation component:
- Cortex Parse Document is a transformation component that uses Snowflake Cortex to extract content from a document on an internal or external stage in the form of an object that contains JSON-encoded objects as strings.
4th December🔗
DesignerNew features 🎉
- Added the option to copy and paste pipelines and pipeline folders in Designer. For more information, read Managing pipelines and Copying pipeline folders.
3rd December🔗
DesignerNew features 🎉
- Added the option to rename pipeline folders in Designer. For more information, read Pipeline folders.
- Added a new Logging tab to the detailed view that appears when you click a task in the Task history tab. This shows a detailed log of each step in a task, as described in Logging.
StreamingImprovements 🔧
- Added a graph of number of rows changed over time to the Manage streaming pipelines dashboard.