BigData Analysis - Cosmos

Chapter:
Data/Context Management
Version:
fiware-cosmos 1.0.0, fiware-cygnus 1.3.0, fiware-sth-comet 1.1.1, fiware-sinfonier 1.0.0
Updated:
2016-12-12
Contact Person:
Please, choose a contact channel:

- Use stackoverflow.com for questions about the software (tags: fiware, fiware-cosmos, fiware-cygnus, fiware-sth, fiware-sinfonier)

- Use ask.fiware.org for general questions about the enabler

- Use the GE owner email when requested by himself

Feedback:

General Information

Here you will find information about available instances of this Generic Enabler you can use. Please check the associated Terms and Conditions. You may create your own dedicated instances following the instructions provided in the tab "Creating Instances"

The instances of GE implementations under a section called "FIWARE Lab" in the "Instances" tab of the catalogue entry are freely available without restrictions.

FIWARE Lab

Sinfonier Global Instance

Service Endpoint (URL):
Specific Features:
Coming soon

Cosmos Global Instance (storage)

Service Endpoint (URL):
Specific Features:

The "new" Global Instance of Cosmos in FIWARE Lab aims to replace the "old" one, which became short in storage and computation resources. For the time being, both instances will coexist, but in the mid term the "old" instance will disappear, so it is recommended you start using the "new" one.

Use the Service Endpoint as the base URL for:

  • Upload/download you data to/from your account:
    http://storage.cosmos.lab.fiware.org:14000/webhdfs/v1/user/your_cosmos_account

As you will notice, a Cosmos account is required (this is where your data will be living at). Please ask for it by sending an email to francisco.romerobueno@telefonica.com, detailing your FIWARE Lab ID (please, check this link if you don't know how to retrieve your ID). A valid OAuth2 token is also required (please, check this link if you don't know how to retrieve one); which must be added to the Service Endpoint as a X-Auth-Token http header.

Please notice you will be sharing this instance with many other users from FIWARE Lab and from FIWARE PPP. This could affect you in terms of performance, nevertheless a private HDFS userspace will be created for you.

Worths mentioning this global instance is based on a shared Hadoop, i.e. FIWARE Lab provides the light version of the enabler.

Cosmos Global Instance (computing)

Service Endpoint (URL):
Specific Features:

The "new" Global Instance of Cosmos in FIWARE Lab aims to replace the "old" one, which became short in storage and computation resources. For the time being, both instances will coexist, but in the mid term the "old" instance will disappear, so it is recommended you start using the "new" one.

Use the Service Endpoint as the base URL for:

  • Running MapReduce jobs:
    http://computing.cosmos.lab.fiware.org:12000/tidoop/v1/user/your_cosmos_account

As you will notice, a Cosmos account is required (this is where your MapReduce jobs metadata will be livint at). Please ask for it by sending an email to francisco.romerobueno@telefonica.com, detailing your FIWARE Lab ID (please, check this link if you don't know how to retrieve your ID). A valid OAuth2 token is also required (please, check this link if you don't know how to retrieve one); which must be added to the Service Endpoint as a X-Auth-Token http header.

Please notice you will be sharing this instance with many other users from FIWARE Lab and from FIWARE PPP. This could affect you in terms of performance, nevertheless a private HDFS userspace will be created for you.

Worths mentioning this global instance is based on a shared Hadoop, i.e. FIWARE Lab provides the light version of the enabler.