New platform enabling near-data processing
Near-data processing, namely placing the processing power near the data rather than sending data to the processor, mitigates challenges associated with the expensive movement of extremely high volumes of data. The EU-funded NEARDATA project will design a near-data platform to enable the consumption, mining and processing of distributed and federated data. The envisaged platform will eliminate the need to optimise the logistics of data access across heterogeneous data locations and pools. It will host an intermediary data service providing serverless connectors that optimise data management operations and interactive queries. Real-time video and event streams will be supported. Ultimately, the platform will host a data broker service, enabling trustworthy data sharing and data pipeline orchestration across the computing continuum.