Transform & Prepare Overview

The Transform & Prepare object type enables comprehensive processing of loaded data within our Workshop Project. With these tools, we can clean, structure, and transform data to prepare it for in-depth analysis. This includes filtering out irrelevant information, standardizing formats, handling missing or inconsistent values, and merging data from multiple sources. By refining the data at this stage, we ensure that it is accurate, consistent, and ready for advanced analytics, reporting, or integration into downstream processes. This preparation is crucial for maintaining data quality and achieving reliable insights.

Development Environments

AutoML

This type of object provides access to the Machine Learning and AI tools available on the ARPIA platform. These tools support a wide range of functions, from generating text embeddings to training custom Machine Learning models tailored to meet specific needs.

• Singular-AI Text Embeddings

Extract

These objects automate the extraction process from MySQL-compatible databases that are registered as Data Sources within the ARPIA workspace. Extractions can be configured to either transfer data directly from table to table or to use custom SQL queries, enabling precise retrieval of the desired information from the database.

• AP DataPipe Engine - MySQL
• AP DataPipe Engine - File
• Python 3.12 DataPipe Engine

High Performance Computing

These objects provide open development environments where you can write and execute code to solve complex, nested problems and create customized processes tailored to your specific needs.

• PHP 7.4 Application
• Python 3.8 Advanced ML Application
• Python 3.8 Advanced ML & Plotly
• R Environment
• NodeJS16 Application

Notification Engine

This type of object provides access to ARPIA's Notification Engine, allowing you to configure and customize the platform's email notification system. To enable functionality, a Mailgun API key is required.

• AP Notification Engine

Prepare & Transform Tools

These type of objects enable flexible transformation and preparation of input data to meet specific project requirements. Capabilities range from adding indexes to tables, converting data types (e.g., string to binary or numeric formats), and transforming dates into numeric formats, to executing SQL code for advanced data preparation. Additionally, they include tools like the SingularAI Text Splitter, allowing text to be segmented as needed. Together, these objects offer a comprehensive suite for refining, structuring, and optimizing data for further processing and analysis.

• AP Prepared Table
• AP Transform String to Binary
• AP Transform String to Numeric
• AP Transform Dates to Numeric
• AP SQL Code Execution
• AP Model Render
• SingularAI Text Splitter

Web-Hook Sender

This type of object allows us to configure the platform’s Web-hook sender, enabling it to send web-hook events to a specified web-hook address.

• AP Web-Hook Sender