Large scale MTConnect data collection

Paper


Cui, Yesheng, Kara, Sami and Chan, Ka C.. 2019. "Large scale MTConnect data collection." 9th International Conference on Cybernetics and Intelligent Systems (CIS) and Robotics, Automation and Mechatronics (RAM) (CIS & RAM 2019). Bangkok, Thailand 18 - 20 Nov 2019 Piscataway, United States. https://doi.org/10.1109/CIS-RAM47153.2019.9095828
Paper/Presentation Title

Large scale MTConnect data collection

Presentation TypePaper
AuthorsCui, Yesheng (Author), Kara, Sami (Author) and Chan, Ka C. (Author)
Journal or Proceedings TitleProceedings of the IEEE 2019 9th International Conference on Cybernetics and Intelligent Systems (CIS) Robotics, Automation and Mechatronics (RAM)
Number of Pages6
Year2019
Place of PublicationPiscataway, United States
ISBN9781728134581
Digital Object Identifier (DOI)https://doi.org/10.1109/CIS-RAM47153.2019.9095828
Web Address (URL) of Paperhttps://ieeexplore.ieee.org/document/9095828
Conference/Event9th International Conference on Cybernetics and Intelligent Systems (CIS) and Robotics, Automation and Mechatronics (RAM) (CIS & RAM 2019)
Event Details
Rank
C
C
Event Details
9th International Conference on Cybernetics and Intelligent Systems (CIS) and Robotics, Automation and Mechatronics (RAM) (CIS & RAM 2019)
Parent
IEEE International Conference on Cybernetics and Intelligent Systems
Event Date
18 to end of 20 Nov 2019
Event Location
Bangkok, Thailand
Abstract

Data collection is the first stage of data lifecycle to drive manufacturing activities such as monitoring, prediction and optimization. Data collection at shop floor is more complex since it is affected by both the physical and cyber worlds. Two common issues are: difficult to collect data of various machines which support different interfaces and communication protocols, and hard to analyze inconsistent data. MTConnect provides a standard solution to collect consistent data from various machines and devices. The current MTConnect applications are based on a single computer which is not suitable to collect large-scale MTConnect data. Cloud computing technology can handle this issue easily such as Apache NiFi. In this paper, a NiFi based solution is proposed to address issues of large-scale MTConnect data collection, processing, and long-term storage. The proposed approach also provides a fault tolerant infrastructure for data provenance to ensure historical data integrity for the requirement of enterprise compliance.

KeywordsMTConnect; NiFi; data collection
ANZSRC Field of Research 2020469999. Other information and computing sciences not elsewhere classified
401407. Manufacturing management
Public Notes

Files associated with this item cannot be displayed due to copyright restrictions.

Byline AffiliationsUniversity of New South Wales
School of Management and Enterprise
Institution of OriginUniversity of Southern Queensland
Permalink -

https://research.usq.edu.au/item/q5z63/large-scale-mtconnect-data-collection

  • 130
    total views
  • 15
    total downloads
  • 4
    views this month
  • 0
    downloads this month

Export as

Related outputs

Interrelation between sustainable dynamic capabilities, corporate sustainability, and sustained competitive advantage
Bari, Nadeem, Chimhundu, Ranga and Chan, Ka Ching. 2024. "Interrelation between sustainable dynamic capabilities, corporate sustainability, and sustained competitive advantage." Sustainability. 16 (7), p. 2864. https://doi.org/10.3390/su16072864
Fintech research: Systematic mapping, classification, and future directions
Liu, Qianhua, Chan, Ka‑Ching and Chimhundu, Ranga. 2024. "Fintech research: Systematic mapping, classification, and future directions." Financial Innovation. 10 (1). https://doi.org/10.1186/s40854-023-00524-z
Leveraging Synthetic Data and Machine Learning for Shared Facility Scheduling
Rabaev, Marsel, Pratama, Handy and Chan, Ka C.. 2024. "Leveraging Synthetic Data and Machine Learning for Shared Facility Scheduling." 17th International Conference on Information Technology and Applications (ICITA 2023). Turin, Italy 20 - 21 Oct 2023 Singapore. Springer. https://doi.org/10.1007/978-981-99-8324-7_34
Cryptocurrency trading: A systematic mapping study
Nguyen, Duy Thien An and Chan, Ka Ching. 2024. "Cryptocurrency trading: A systematic mapping study." International Journal of Information Management Data Insights. 4 (2). https://doi.org/10.1016/j.jjimei.2024.100240
A survey of autonomous monitoring systems in mental health
Gopalakrishnan, Abinaya, Gururajan, Raj, Zhou, Xujuan, Venkataraman, Revathi, Chan, Ka Ching and Higgins, Niall. 2024. "A survey of autonomous monitoring systems in mental health." WIREs Data Mining and Knowledge Discovery. 14 (3). https://doi.org/10.1002/widm.1527
Digital economy: Development of information and communication technologies in a sustainable economic environment (Eds.)
Chan, Ka Ching, Lee, Angela Siew Hoong and Chimhundu, Ranga. 2023. "Digital economy: Development of information and communication technologies in a sustainable economic environment (Eds.)." Sustainability.
Attribute Selection Hybrid Network Model for risk factors analysis of postpartum depression using Social media
Gopalakrishnan, Abinaya, Gururajan, Raj, Venkataraman, Revathi, Zhou, Xujuan, Chan, Ka Chan, Saravanan, Arul and Sen, Maitrayee. 2023. "Attribute Selection Hybrid Network Model for risk factors analysis of postpartum depression using Social media." Brain Informatics. 10. https://doi.org/10.1186/s40708-023-00206-7
A systematic review of literature on credit card cyber fraud detection using machine and deep learning
Marazqah Btoush, Eyad Abdel Latif, Zhou, Xujuan, Gururajan, Raj, Chan, Ka Ching, Genrich, Rohan and Sankaran, Prema. 2023. "A systematic review of literature on credit card cyber fraud detection using machine and deep learning." PeerJ Computer Science. 9 (1). https://doi.org/10.7717/peerj-cs.1278
Research on agricultural product quality traceability system based on blockchain technology
Zheng, Fang, Huang, Siyuan, Zhou, Xiong, Ta, Shujun, Zhou, Xujuan, Chan, Ka Ching and Gururajan, Raj. 2023. "Research on agricultural product quality traceability system based on blockchain technology ." Web Intelligence. https://doi.org/10.3233/WEB-220088
Assessing spatial inequality in cancer service access in regional areas
Chan, Ka C., Williams, R. F. G. and Lenard, Christopher T.. 2022. "Assessing spatial inequality in cancer service access in regional areas." Cogent Public Health. 9 (1), pp. 1-8. https://doi.org/10.1080/27707571.2022.2127188
Generation of synthetic manufacturing datasets for machine learning using discrete-event simulation
Chan, K. C., Rabaev, Marsel and Pratama, Handy. 2022. "Generation of synthetic manufacturing datasets for machine learning using discrete-event simulation." Production and Manufacturing Research. 10 (1), pp. 337-353. https://doi.org/10.1080/21693277.2022.2086642
A Survey on Credit Card Fraud Detection Techniques in Banking Industry for Cyber Security
Btoush, Eyad, Zhou, Xujuan, Gururajan, Raj, Chan, KC and Tao, XiaoHui. 2021. "A Survey on Credit Card Fraud Detection Techniques in Banking Industry for Cyber Security." 8th IEEE International Conference on Behavioural and Social Computing (BESC 2021). Doha, Qatar 29 - 31 Oct 2021 Doha, Qatar. https://doi.org/10.1109/BESC53957.2021.9635559
Dynamic capabilities to achieve corporate sustainability: A roadmap to sustained competitive advantage
Bari, Nadeem, Chimhundu, Ranga and Chan, Ka-Ching. 2022. "Dynamic capabilities to achieve corporate sustainability: A roadmap to sustained competitive advantage." Sustainability. 14 (3), pp. 1-28. https://doi.org/10.3390/su14031531
Integration of blockchains with management information systems
Chan, Ka Ching, Zhou, Xujuan, Gururajan, Raj, Zhou, Xiong, Ally, Mustafa and Gardiner, Michael. 2020. "Integration of blockchains with management information systems." Tamba, Tua A. (ed.) 2019 International Conference on Mechatronics, Robotics and Systems Engineering (MoRSE 2019). Bali, Indonesia 04 - 06 Dec 2019 https://doi.org/10.1109/MoRSE48060.2019.8998694
A Case Study of Predicting Banking Customers Behaviour by Using Data Mining
Zhou, Xujuan, Bargshady, Ghazal, Abdar, Moloud, Tao, Xiaohui, Gururajan, Raj and Chan, K. C.. 2019. "A Case Study of Predicting Banking Customers Behaviour by Using Data Mining." 6th International Conference on Behavioral, Economic, and Socio-Cultural Computing (BESC 2019). Beijing, China 28 - 30 Oct 2019 United States. https://doi.org/10.1109/BESC48373.2019.8963436
A set of quality metrics for the evaluation of voice termination services
Chan, Ka C., Zhou, Xujuan, Gururajan, Raj and Barua, Prabal. 2018. "A set of quality metrics for the evaluation of voice termination services." 5th International Conference on Behavioral, Economic, and Socio-Cultural Computing (BESC 2018). Kaohsiung, Taiwan 12 - 14 Nov 2018 Los Alamitos, CA, United States. https://doi.org/10.1109/BESC.2018.00036
Based on the internet plus the safety of agricultural products traceability research
Zhou, Xiong, Zheng, Fang, Chan, Ka C., Zhou, Xujuan, Gururajan, Raj, Wu, Zhangguang and Zhou, Enxing. 2018. "Based on the internet plus the safety of agricultural products traceability research." 5th International Conference on Behavioral, Economic, and Socio-Cultural Computing (BESC 2018). Kaohsiung, Taiwan 12 - 14 Nov 2018 United States. https://doi.org/10.1109/BESC.2018.8697322
Monitoring and Control of Unstructured Manufacturing Big Data
Cui, Yesheng, Kara, Sami and Chan, Ka C.. 2021. "Monitoring and Control of Unstructured Manufacturing Big Data." IEEE International Conference on Industrial Engineering and Engineering Management (IEEM 2020). Marina Bay Sands, Singapore 14 - 17 Dec 2020 Piscataway, United States. https://doi.org/10.1109/IEEM45057.2020.9309975
Making investment decisions on RFID technology: an evaluation of key adoption factors in construction firms
Mabad, Tarik, Ali, Omar, Ally, Mustafa, Wamba, Samuel Fosso and Chan, Ka Ching. 2021. "Making investment decisions on RFID technology: an evaluation of key adoption factors in construction firms." IEEE Access. 9, pp. 36937-36954. https://doi.org/10.1109/ACCESS.2021.3063301
An instrument for measuring the influence of consumers’ cultural values on functional food perception
Neupane, Saugat, Chimhundu, Ranga and Chan, K. C.. 2021. "An instrument for measuring the influence of consumers’ cultural values on functional food perception." British Food Journal. 123 (7), pp. 2582-2600. https://doi.org/10.1108/BFJ-11-2020-0997
Self-Sorting of Solid Waste using Machine Learning
Chan, Tyson, Cai, Jacky H., Chen, Francis and Chan, Ka C.. 2020. "Self-Sorting of Solid Waste using Machine Learning." Hernes, Marcin, Wojtkiewicz, Krystian and Szczerbicki, Edward (ed.) 12th International Conference on Computational Collective Intelligence (ICCCI 2020). Da Nang, Vietnam 30 Nov - 03 Dec 2020 Cham, Switzerland. https://doi.org/10.1007/978-3-030-63119-2
Designing a Testbed to Assess Secure Control of Cyber-Physical Systems
Park, Eugene and Chan, Ka Ching. 2020. "Designing a Testbed to Assess Secure Control of Cyber-Physical Systems." 2019 International Conference on Mechatronics, Robotics and Systems Engineering (MoRSE 2019). Bali, Indonesia 04 - 06 Dec 2019 Piscataway, United States. https://doi.org/10.1109/MoRSE48060.2019.8998684
From Traceability to Provenance of Agricultural Products through Blockchain
Zhou, Xiong, Zheng, Fang, Zhou, Xujuan, Chan, Ka Ching, Gururajan, Raj, Wu, Zhangguang and Zhou, Enxing. 2020. "From Traceability to Provenance of Agricultural Products through Blockchain." Web Intelligence. 18 (3), pp. 181-189. https://doi.org/10.3233/WEB-200440
A state-of-the-art review on artificial intelligence for Smart Buildings
Panchalingam, Rav and Chan, Ka C.. 2021. "A state-of-the-art review on artificial intelligence for Smart Buildings." Intelligent Buildings International. 13 (4), pp. 203-226. https://doi.org/10.1080/17508975.2019.1613219
Manufacturing big data ecosystem: A systematic literature review
Cui, Yesheng, Kara, Sami and Chan, Ka C.. 2020. "Manufacturing big data ecosystem: A systematic literature review." Robotics and Computer Integrated Manufacturing. 62, pp. 1-20. https://doi.org/10.1016/j.rcim.2019.101861
Cultural values affect functional food perception
Neupane, Saugat, Chimhundu, Ranga and Chan, K. C.. 2019. "Cultural values affect functional food perception." British Food Journal. 121 (8), pp. 1700-1714. https://doi.org/10.1108/BFJ-03-2019-0178
Determination of factors influencing student engagement using a learning management system in a tertiary setting
Barua, Prabal Datta, Zhou, Xujuan, Gururajan, Raj and Chan, Ka C.. 2018. "Determination of factors influencing student engagement using a learning management system in a tertiary setting." 2018 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2018). Santiago, Chile 03 - 06 Dec 2018 Los Alamitos, CA, United States. https://doi.org/10.1109/WI.2018.00-30
A study investigating the relationships between consumers' cultural values, their functional food perception and behaviour
Neupane, Saugat, Chimhundu, Ranga and Chan, K. C.. 2018. "A study investigating the relationships between consumers' cultural values, their functional food perception and behaviour." Melbourne International Business and Social Science Research Conference (MIBSRC 2018). Melbourne, Australia 27 - 28 Oct 2018
Measuring inequality in society
Chan, Ka Ching, Lenard, Christopher T., Mills, Terence M. and Williams, Ruth F. G.. 2019. "Measuring inequality in society." Communications in Statistics: Theory and Methods. 48 (1), pp. 88-99. https://doi.org/10.1080/03610926.2018.1501486
Assessment of electronic noses for support of a canine scent detection
Kerollos, Mark N., Chan, Ka C., Bennett, Pauleen and Howell, Tiffani. 2015. "Assessment of electronic noses for support of a canine scent detection." 10th International Conference on Information Technology and Applications (ICITA 2015). Sydney, Australia 01 - 04 Jul 2015 Australia.
The La Trobe e-Sanctuary: building a cross-reality wildlife sanctuary
Loke, Seng W., Thai, Ba Son, Torabi, Torab, Chan, Ka, Deng, Dennis, Rahayu, Wenny and Stocker, Andrew. 2015. "The La Trobe e-Sanctuary: building a cross-reality wildlife sanctuary." 11th International Conference on Intelligent Environments (IE´15). Prague, Czech Republic 15 - 17 Jul 2015 New York, United States. https://doi.org/10.1109/IE.2015.36
A modular system for canine augmentation
Smith, Daniel and Chan, Ka Ching. 2016. "A modular system for canine augmentation." Tien, David (ed.) 11th International Conference on Information Technology and Applications (ICITA 2016). Sydney, Australia 01 - 04 Jul 2016 Australia.
Measuring cancer inequality with the cumulative rate
Mills, Terence, Chan, Ka C., Kippen, Rebecca, Lenard, Christopher T. and Williams, Ruth F.G.. 2016. "Measuring cancer inequality with the cumulative rate." 2016 World Cancer Congress. Paris, France 31 Oct - 03 Nov 2016
Applications of the cumulative rate to kidney cancer statistics in Australia
Brennan, Janelle, Chan, K. C., Kippen, Rebecca, Lenard, C. T., Mills, T. M. and Williams, Ruth F. G.. 2016. "Applications of the cumulative rate to kidney cancer statistics in Australia." Skiadas, Christos H. (ed.) 4th Stochastic Modeling Techniques and Data Analysis International Conference with Demographics Workshop (SMTDA 2016). Valletta, Malta 01 - 04 Jun 2016
Measuring inequality in society
Mills, T. M., Lenard, C. T., Chan, K. C. and Williams, Ruth F. G.. 2016. "Measuring inequality in society." Skiadas, Christos H. (ed.) 4th Stochastic Modeling Techniques and Data Analysis International Conference with Demographics Workshop (SMTDA 2016). Valletta, Malta 01 - 04 Jun 2016
Applications of the cumulative rate to kidney cancer statistics in Australia
Brennan, Janelle, Chan, K. C., Kippen, Rebecca, Lenard, C. T., Mills, T. M. and Williams, Ruth F. G.. 2018. "Applications of the cumulative rate to kidney cancer statistics in Australia." Skiadas, Christos H. and Skiadas, Charilaos (ed.) Demography and health issues: Population aging, mortality and data analysis. Chan, Switzerland. Springer. pp. 97-106
Bowel cancer demographics
Chan, K. C., Lenard, C. T., Mills, T. M. and Williams, Ruth F. G.. 2015. "Bowel cancer demographics." Karagrigoriou, Alex, Oliveira, Teresa and Skiadas, Christos H. (ed.) Statistical, stochastic and data analysis methods and applications. Greece. International Society for the Advancement of Science and Technology. pp. 159-171
Market share modelling and forecasting using Markov chains and alternative models
Chan, Ka Ching. 2015. "Market share modelling and forecasting using Markov chains and alternative models." International Journal of Innovative Computing Information and Control. 11 (4), pp. 1205-1218.
Modeling competition over product life cycles
Chan, Ka Ching and Mills, Terry M.. 2015. "Modeling competition over product life cycles." Asia-Pacific Journal of Operational Research. 32 (4), pp. 1-16. https://doi.org/10.1142/S0217595915500219
Building an end-to-end ISP broadband infrastructure as an advanced networking subject
Miles, Christopher Raymond and Chan, Ka Ching. 2016. "Building an end-to-end ISP broadband infrastructure as an advanced networking subject." Computer Applications in Engineering Education. 24 (1), pp. 16-26. https://doi.org/10.1002/cae.21667
When probability trees don't work
Chan, K. C., Lenard, C. T. and Mills, T. M.. 2016. "When probability trees don't work." International Journal of Mathematical Education in Science and Technology. 47 (6), pp. 972-976. https://doi.org/10.1080/0020739X.2015.1124932
A rapid deployment big data computing platform for cloud robotics
Duggan, Leigh, Dowzard, James, Katupitiya, Jayantha and Chan, Ka C.. 2017. "A rapid deployment big data computing platform for cloud robotics." International Journal of Computer Networks and Communications. 9 (6), pp. 77-88. https://doi.org/10.5121/ijcnc.2017.9606
PaleoView: a tool for generating continuous climate projections spanning the last 21 000 years at regional and global scales
Fordham, Damien A., Saltre, Frederik, Haythorne, Sean, Wigley, Tom M. L., Otto-Bliesner, Bette L., Chan, Ka Ching and Brook, Barry W.. 2017. "PaleoView: a tool for generating continuous climate projections spanning the last 21 000 years at regional and global scales." Ecography: pattern and diversity in ecology. 40 (11), pp. 1348-1358. https://doi.org/10.1111/ecog.03031
A networking laboratory using an integrated mixture of physical equipment and simulators
Chan, Ka C. and Haythorne, Sean. 2017. "A networking laboratory using an integrated mixture of physical equipment and simulators." Computer Applications in Engineering Education. 25 (5), pp. 681-692. https://doi.org/10.1002/cae.21829
Targeting Zero Non-Attendance in Healthcare Clinics
Chan, Ka C. and Chan, David B.. 2012. "Targeting Zero Non-Attendance in Healthcare Clinics." Smith, Anthony C., Armfield, Nigel R. and Eikelboom, Robert H. (ed.) Global Telehealth 2012. IOS Press. pp. 52-57
Design of a Large Scale Community-Based Self-Management System for Diabetes Mellitus
Chan, Ka C., Wong, Lucia and Chan, David B.. 2012. "Design of a Large Scale Community-Based Self-Management System for Diabetes Mellitus." Smith, Anthony C., Armfield, Nigel R. and Eikelboom, Robert H. (ed.) Global Telehealth 2012. IOS Press. pp. 58-66
An integrated virtual and physical network infrastructure for a networking laboratory
Chan, Ka Ching and Martin, Mary. 2012. "An integrated virtual and physical network infrastructure for a networking laboratory." ICCSE 2012: International Conference on Computer Science and Education. Melbourne, VIC, Australia 14 - 17 Jul 2012 Australia. IEEE (Institute of Electrical and Electronics Engineers). https://doi.org/10.1109/ICCSE.2012.6295333