The Distributed Sensing Systems (DSS) Group is currently developing a low-cost LoRaWAN-enabled smart camera device and compression mechanisms to afford frequent images and classifications to be transmitted over the highly constrained communications for high temporal-spatial ground-based monitoring of animal (pest/wildlife) presence. Audio recorders can address the challenges of camera-based monitoring by recording species over far larger areas. Researchers increasingly place audio recorders in forests and other ecosystems to monitor birds, insects, frogs, and other animals. Such audio-based monitoring falls in the bigger area of Bioacoustics, which is the study of the production, transmission and reception of animal sounds. The proposed project aims to take these advantages of audio monitoring to further improve ground-based monitoring of animals in the ongoing DSS project.
Deep learning, a branch of Artificial Intelligence (AI), has revolutionised audio and image processing. This project aims to use deep learning to develop a highly accurate animal species recognition system from the audio recording. Existing studies use deep learning techniques to recognise animal species from audio, but the focus is not on deployability but on improving accuracy metrics. As a result, current state-of-the-art models are far too computationally expensive to deploy using today's resource-constrained edge devices. This project aims to address this challenge enabling the processing of AI algorithms on edge devices (known as Edge AI). The aims are as follows:
• Develop a lightweight deep learning audio classifier that (a) distributes classification tasks to multiple edge device and (b) integrate the results to make classification decision.
• Propose distributed onboard training techniques subject to the limited bandwidth and limited processing power of edge devices. This can be useful when the classification and data collection need to occur simultaneously. A preloaded model on edge can be updated with the on-device training data without needing bandwidth to transfer the training data into a central location for training. Only any change in the model needs to be sent to the central location for updating the global model.
• Propose an onboard lightweight fusion of audio with images to improve the performance of the classification.
• Conduct on-device testing and report operating requirements.
Besides ground-based monitoring, some other high-level opportunity this project can link to is the monitoring of environmental health for sensitive ecosystems (reefs, rainforests), especially when looking at recovery after natural disasters (floods, bushfires, coral bleaching events); or when characterising the industrial impacts on the ecosystems (e.g., livestock/mining industries).
CSIRO Data61 PhD Scholarship
- Stipend valued at the 2022 base rate of AUD $28,854 and/or top-up scholarship of AUD $10,000 per annum;
- Full tuition fees for a period of 6 semesters (full-time equivalent). Domestic students will be allocated a Research Training Program (RTP) Fees Offset Place, whereas international students will be offered an International Fees Research Scholarship;
- Operating expense support of up to $5,000 learning and development funding over the term of the scholarship to support your research and future career;
- Access to world-class research facilities and excellent tools, support and resources to bring your research to life;
- Connect into an inclusive culture where the diversity of people, experiences, and views are valued and where you will use your skills to help solve complex national and global problems.
To be eligible, applicant must:
- have completed a Bachelor Degree in Computer Science or Electrical Engineering with First Class Honours, or equivalent level;
- have applied, or currently enrolled in the PhD at UniSQ;
- be an Australian citizen or permanent resident, or New Zealand citizen, or an international student already residing within Australia;
- not be receiving equivalent support providing a benefit greater than 75% of the student’s stipend rate;
commence or continue the PhD in 2022.
- have demonstrated knowledge and experience in using machine learning and deep learning models with solid expertise in using the relevant architectures for implementations.
- have demonstrated manuscript/research proposal preparation skills, including a solid track record of refereed research publications in top machine learning and deep learning venues.
If you are interested, first contact Associate Professor Rajib Rana (Rajib.email@example.com) ASAP. To apply, please ensure you have digital copies of the below information:
- Curriculum vitae;
- Education qualifications (testamur and academic transcripts for all undergraduate and postgraduate awards);
- List of any research presentations and/or publications
- Documentation confirming citizenship/current presence in Australia.
Application for stipend must be made via the CSIRO Data61 portal https://jobs.csiro.au/job/Various-Data61-PhD-Scholarships/796808000/
Application for admission into UniSQ should be made through the HDR Application Steps page.
Further information about this scholarship can be obtained from the Graduate Research School at firstname.lastname@example.org.