Create Lotame data source

Closed Posted 5 years ago Paid on delivery
Closed Paid on delivery

General Objective

Create a Lotame datasource for a data mining product

Specific Objectives

Create a AWS lambda function for extracting data from a third party API (Data Extraction)

Create a Python function for transforming this data into rows (Data transformation)

delivery time: 3 days

Context

A W Datasource is a software component that is basically responsible for retrieving information from a specific source in a specific format. After the information is retrieved, a transformation function is applied for converting the data into a row record, required for storing the information as a table.

Data Extraction Function

The objective of this element is to retrieve the data from the source, without applying any changes nor additional logic.

Consider this element as a bridge which consumes the API using the configuration parameters received (input parameters) and provide exactly the same result that the API returns.

The magic of this element consists on consuming any API endpoint available by the provider passing the data to the next point in the chain. Changing the input parameter must be the only thing required for reaching a different endpoint or to consume a specific endpoint with different options. The goal behind this is to have a generic datasource capable of retrieving any info available by the provider. Using this approach, a new requirement coming from a datasource user will not require any code modification or development.

Transformation Function

This is where the conversion and the handling of the information returned by the provider. At the end of the process must convert the data into a collection of rows. Each row is passed to the helper as an object. This step is for converting the raw data returned by the provider into something that can be used for the table creation.

we will provide the credentials once the project be accepted.

Amazon Web Services Data Mining Elasticsearch Python Software Architecture

Project ID: #18550206

About the project

4 proposals Remote project Active 5 years ago

4 freelancers are bidding on average $68 for this job

sathish2connect

I have rich experience in data migration and ETL projects using python and java. Can meet the expectations. Thanks for considering the bid.

$55 USD in 10 days
(7 Reviews)
3.0
anshsparkle

HELLO I CAN START RIGHT NOW - I AM EXPERT IN Amazon Web Services Data Mining and I BET YOU CANNOT FIND BETTER FREELANCER THAN ME ... pLEASE MESSEGE ME AND LETS DISCUSS THE THINGS THANKS

$83 USD in 10 days
(1 Review)
1.0
ramzan118

Dear Sir, Thank you very much for posting this job. I have gone through of your job requirements and I am sure to perform these roles. I believe I posses the necessary skills and experience you are seeking for and wou More

$83 USD in 10 days
(0 Reviews)
0.0
dilanharshan143

Hello, there, I am very happy to put my bid on your project. I am an expert of software development, so I am interested in and confident to do this project. And I am c. member of c. team whit $0 developers who have g More

$50 USD in 1 day
(0 Reviews)
0.0