Skip to main content

Data Pipeline Overview

Welcome to the Data Pipeline section of BeWo's documentation. The Data Pipeline is a crucial component of BeWo's platform, responsible for processing and managing the data used in your CO2e emissions calculations. This overview will help you understand what the Data Pipeline is, how it works, and how you can interact with it to ensure accurate and efficient carbon accounting.

What Is the Data Pipeline?​

The Data Pipeline is BeWo's system for ingesting, processing, and managing the data pulled from your ERP system and other integrations. It automates the flow of data from its source to the point where it's ready for emissions calculation and reporting.

Key Functions of the Data Pipeline​

  • Data Ingestion: Pulls data from your connected ERP systems and integrations based on your selected companies, financial accounts, and reporting years.
  • Data Processing: Uses BeWo's AI-CO2e engine to classify and calculate emissions from the ingested data.
  • Error Handling: Identifies and flags any errors or warnings in the data that require user attention.
  • Data Management: Allows you to review, edit, and approve data before it is finalized for reporting.

Why Is the Data Pipeline Important?​

  • Automation: Eliminates the need for manual data entry, reducing errors and saving time.
  • Accuracy: Ensures that only verified and processed data is used in your emissions calculations.
  • Transparency: Provides visibility into each step of the data processing workflow.
  • Control: Enables you to manage and oversee the data before it impacts your emissions reporting.

The Data Pipeline interface is designed to give you a clear view of your data's status and provide tools to manage it effectively.

Main Components​

  • Dashboard: Offers an overview of the data processing status, including the number of records in each stage.
  • Processing Queue: Shows data that is currently being processed or queued for processing.
  • Error and Warning Logs: Lists any data entries that have encountered issues during processing.
  • Data Review: Allows you to inspect individual vouchers and lines, make corrections, and approve data.

Data Processing Workflow​

  1. Data Ingestion: Data is pulled from your ERP system based on your integration settings.
  2. AI Classification: BeWo's AI analyzes and classifies the data, assigning appropriate categories, types, and estimation approaches.
  3. CO2e Calculation: Emissions are calculated using the relevant emission factors.
  4. Data Review: You can review the processed data, fix any errors or warnings, and approve it for reporting.
  5. Posting Data: Approved data is posted and becomes part of your official emissions records.

Understanding Processing Statuses​

Each data entry in the Data Pipeline has a Processing Status that indicates its current state:

  • Waiting for Processing: Data is queued and will be processed soon.
  • Ready: Data has been processed and is ready for your review.
  • Warning: The AI encountered uncertainties; the data requires your attention.
  • Error: An issue prevented the data from being processed correctly.
  • Posted: Data has been reviewed and approved for reporting.

Next Steps​

Now that you have an overview of the Data Pipeline, you can explore the following articles to dive deeper:

Need Help?​

If you have any questions or need assistance navigating the Data Pipeline, our support team is here to help.

👉 Contact Support: Support Page

By understanding the Data Pipeline, you can effectively manage your data processing workflow, ensuring that your CO2e emissions calculations are accurate and reliable.