Skip to content
DataOps.live Professional EditionNEW
Purpose-built environment for small data teams and dbt Core developers.
DataOps.live Enterprise
DataOps.live is the leading provider of Snowflake environment management, end-to-end orchestration, CI/CD, automated testing & observability, and code management, wrapped in an elegant developer interface.
Spendview for Snowflake FREE

 

An inexpensive, quick and easy way to build beautiful responsive website pages without coding knowledge.
Getting Started
Docs- New to DataOps.liveStart learning by doing. Create your first project and set up your DataOps execution environment.
Join the Community
Join the CommunityFind answers to your DataOps questions, collaborate with your peers, share your knowledge!
#TrueDataOps Podcast
#TrueDataOps PodcastWelcome to the #TrueDataOps podcast with your host Kent Graziano, The Data Warrior!
Academy
DataOps AcademyEnroll in the DataOps.live Academy to take advantage of training courses. These courses will help you make the most out of DataOps.live.
Resource Hub
On-Demand Resources: eBooks, White Papers, Videos, Webinars

Learning Resources
A collection of resources to support your learning journey.

Customer stories
Events
Connect with fellow professionals, expand your network, and gain knowledge from our esteemed product and industry experts.
#TrueDataOps.org
#TrueDataOps.Org#TrueDataOps is defined by seven key characteristics or pillars:
Blogs
Stay informed with the latest insights from the DataOps team and the vibrant DataOps Community through our engaging DataOps blog. Explore updates, news, and valuable content that keep you in the loop about the ever-evolving world of DataOps.
In The News

In The News

Stay up-to-date with the latest developments, press releases, and news.
About Us
About UsFounded in 2020 with a vision to enhance customer insights and value, our company has since developed technologies focused on DataOps.
Careers

Careers

Join the DataOps.live team today! We're looking for colleagues on our Sales, Marketing, Engineering, Product, and Support teams.
Thomas Steinborn, SVP ProductsJun 19, 2023 8:20:21 AM4 min read

Unleashing Data Product Management and Observability

In today’s data-driven world, businesses constantly seek innovative solutions to manage and optimize their data operations. DataOps.live, a leading data operations platform, has recently unveiled two groundbreaking features. Data Product Management and Observability change how organizations handle their data.

In this blog post, we will delve into the exciting capabilities of these new additions. We explore how they can empower businesses to harness the full potential of their data assets.

Data Product Management

Data Product Management: turning data into actionable products DataOps.live’s Data Product Management feature introduces a significantly improved approach to data operations. It enables organizations to treat their data as valuable products rather than static assets. This feature allows businesses to define, build, and manage data products aligned with their objectives and end-user requirements.

Everyone can build Data Products!

Data Product Management streamlines the entire data product lifecycle, from ideation and development to deployment and maintenance. By leveraging this set of features, businesses can foster cross-functional collaboration. Data Products need to meet the needs of various teams and stakeholders. Moreover, integrating Data Products into existing workflows and systems, enabling seamless access to data assets is required.

Data Product Management Lifecycle phases


Data Product Management adopts many best practices established with software developers.

First, you must manage data as a product. Like any product, your data needs a roadmap.

Change requests originating from your stakeholder will be captured as a ticket. It is easy to track development work with a ticket. Additionally, it is safe to develop in a feature branch before release.

Second, we provide you with the DataOps Development Environment (DDE) to quickly iterate on your requirements. Within the development environment, you can define the Data Product specification. Check the backward compatibility of your datasets built by the data pipeline directly in DDE. To automate, use Git pre-commit hooks, ensuring nothing breaks in production.

Last, we are making it easy to share your Data Product contract with your team members.

Provide an easily readable rendering of your Data Product manifest to everyone. Review the core attributes and datasets with their metadata. Examine the current value of your data quality KPIs. Capture each result as a Service Level Indicator (SLI).

Once your new feature is developed, optionally publish the latest results to your data catalog of choice. Choose from the ones we support today, like data.world or Collibra, and contact us for those up-and-coming.

Comprehensive Observability

Comprehensive Observability: gaining deep insights into Data Operations, the DataOps observability feature introduced by DataOps.live empowers organizations with complete visibility and insights into their data operations. It provides real-time monitoring, tracking, and analysis of data pipelines, workflows, and processes. Observability allows businesses to identify bottlenecks, performance issues, and potential areas for optimization.

Comprehensive observability provides a 360-degree view of your Data Products!

Comprehensive observability is built on a unified view of infrastructure spend, data pipeline monitoring, usage of your data product, and data quality KPIs


Businesses can improve data operations by proactively identifying and resolving issues. This will lead to increased reliability, efficiency, and accuracy. Ultimately, this will result in better decision-making and improved business outcomes.

We focus on four key groups within your organization: Data Product Owners, DataOps Developers, Data Engineers, and business stakeholders. Our goal is to cater to the needs of all these different users.

Data Product Owners want to understand the cost, monitor the usage, and assess the impact of data products. DataOps developers are focused on the well-being of their data pipelines. They aim to minimize the cost of the infrastructure and evaluate the extent of any runtime issues.

Data executives, such as the Chief Data Officer, must keep track of current spending compared to the budget. They must also understand adoption and usage, as well as manage the budgets for their data teams’ data domain.

With excitement, DataOps.live announces the free Spendview for Snowflake. Anyone with a Snowflake account can use it.

Reduce overall Snowflake spend by 15%!

Spendview offers the first of many comprehensive observability use cases. It focuses on Snowflake operations and is part of a more extensive range of data observability tools to come.

Screenshot - DataOps.live Spendview for Snowflake


Have you ever wondered about critical questions like:

  • Who is my biggest spender?
  • Do I have enough and the right size warehouses?
  • Are my warehouses and databases healthy?
  • Do my users have a good experience using Snowflake?

Spendview answers these questions and more for you with ease.

Conclusion

With the introduction of Data Product Management and Comprehensive Observability, DataOps.live continues redefining the data operations landscape. These powerful features enable businesses to unlock the true value of their data assets, transforming raw data into actionable products and gaining deep insights into their data operations. Companies can confidently manage data operations while adhering to data privacy regulations and industry standards.

By adopting DataOps.live’s innovative platform, organizations can streamline data operations, foster collaboration, optimize performance, and ensure data governance and compliance. Embrace the future of data operations with DataOps.live and unleash the full potential of your data-driven initiatives.

 

avatar

Thomas Steinborn, SVP Products

Thomas comes to DataOps.live with over 20 years of experience in integration technology ranging from application integration over data integration to data governance. He believes in DevSecOps principles as applied to Data Products and Data Operations (DataOps) and has brought them to the products he’s led since 2005. Thomas has spent over ten years scaling product management organizations at the global level. Before DataOps, he was Chief Product Officer at Infoniqa, the Human Capital Management, Payroll, and Time Solutions leader in the DACH region. Before that, he led product and user experience as VP of Products at Talend, a leading provider of data integration, data integrity, and data governance solutions.

RELATED ARTICLES