Data Engineers

Deliver analytics at the speed of business

Eckerson Group's Dave Wells describes how to create a data marketplace to increase data re-use.

Rich marketplaces for data re-use

For many years data production was a one-way pipeline.

Source systems dumped data exhaust, its messy, raw structure accessible only by an information technology professional. Secure access, specialized scripts, and hours of wrangling were necessary to build a meaningful data structure. And that structure became the single source of truth. Because it was too hard to iterate.

Today that rough, one-lane-highway has been replaced by schema-on-read, self-service applications and a rich world of iterative data preparation.

The era of the data marketplace is here.

Read More

Data Catalog – the Heart of a Marketplace

Data Catalogs Democratize Data Access

A modern data catalog makes data – and information about this data – accessible to all.

Data catalogs demystify the production, reuse and sharing of data sets. Just as shoppers browse through vendor stalls in a marketplace to find goods – data scientists, analysts, and other data consumers can browse through a data catalog to find data assets.

Data catalogs create a marketplace that inventories data, catalogs contextual information, and shares the knowledge needed to trust enterprise data.

A single source of reference is created in the enterprise.


Aggregate All Data Knowledge

When the data warehouse was king, registering data for reuse was straightforward. A data model held the keys to the kingdom. But today, even creating a simple inventory of your data is a big data challenge.

Leverage what is known and automate your inventory. Alation connects directly to databases, Hadoop files and business intelligence tools to automate the registration of your data. The inventory is then enriched with behavioral analysis using the query logs from your organization. This automated approach creates a rich data catalog that meets self-service IT and business needs.


Add CrowdSourdced Insight

Alation analyzes the relationships between your data, your data assets and the people accessing them. This can become a rich repository of knowledge for maintaining data models, schemas, and assets for the organization.

Answer questions of usage and popularity. Understand common joins, filters and data manipulations. Gain visibility into connections made across databases, Hadoop & semantic layers.

Alation becomes your window into the world of data usage.


Visibility Balanced by Security

Alation uses standard ODBC/JDBC connections to connect to your sources of data and ensures that all security and permission policies are mirrored from your source systems into the data catalog.

Interested in communicating data availability without revealing secure data points? Alation allows administrators to reveal only the metadata that’s necessary based on the class of user.

Security is key to an open data marketplace.


Open APIs for Data Management

While speeding analyst productivity, supporting collaborative analytics and embracing effective data stewardship, Alation becomes a clearing house for knowledge about your data.

And we make it easy to leverage this single point of reference not only for human data interaction but also for system-to-system communications. Alation ships with a set of open APIs for connecting to your data transformation and management ecosystem.

Alation Helps Data Creators

Package Data with Context

Ensure that your data products are always presented in the context of data history, lineage & fit for analysis

Encourage Data Asset Reuse

Lower the barrier to data consumers for self-serving the highest quality data assets in your organization

Host a Data Marketplace

Automate the process of cataloging, evaluating & updating data assets