Attunity offers a path to secure file sharing with Hadoop
- By Rutrell Yasin
- Nov 15, 2012
Many government and private-sector organizations are adopting Hadoop open-source software to store, manage and process the vast amounts of data being collected from a variety of sources, including cameras, sensors and disparate computer systems. However, IT organizations are struggling to move the data into computing platforms where business intelligence and analytics can be applied for real-time decision-making.
Attunity is the latest company offering technology that integrates with Hadoop to improve big data analytics. The company’s Attunity Managed File Transfer for Hadoop automates and speeds up file collection and data transfer with the Hadoop File System (HDFS). Integration with HDFS allows the gateway technology to move data in and out of Hadoop either in batch or real time, according to Attunity executives. Organizations can collect and transfer big data in both the cloud and enterprise data centers, they said.
Attunity MFT, the company’s file transfer management platform that provides machine-to-machine and application-to-application file transfers, is used by federal agencies such as the Homeland Security and Treasury departments, the Federal Aviation Administration and the U.S. Postal Service.
Attunity MFT for Hadoop features include:
- Enterprise-scale automation and scheduling for IT processes that collect and transfer data into HDFS, with dashboards and notifications to monitor and control data transfer.
- Support for many sources of data, including enterprise as well as cloud file systems, Web protocols such as HTTP/S and S/FTP, e-mail and desktop.
- Support for Hadoop distributions based on standard HDFS 1.0 or higher, such as those by Apache, HortonWorks and Cloudera.
- A Web services API for integration with business systems such as enterprise resource planning, business process management and customer relationship management.
- Multistage processing of data being transferred with security configuration options to meet the needs of highly regulated industries.
Other companies are providing hooks into Hadoop, integrating real-time operational intelligence with big data storage and batch processing. For instance, Splunk recently unveiled Splunk Hadoop Connect, which integrates and moves data easily between Hadoop and the Splunk Enterprise software.
Splunk Enterprise collects, indexes and harnesses fast moving machine data generated by organizations’ applications, servers and devices, whether they are physical, virtual or in the cloud. Splunk also troubleshoots application problems and investigates security incidents, helping organizations avoid service degradation or outages.
The company also unveiled The Splunk App for HadoopOps, an application that provides real-time monitoring and analysis of the health and performance of the entire Hadoop environment all from one interface.