Lingua Custodia

🎉 Our second research paper for 2024!! We are on a roll! Well done Gaëtan Caillaut Mariam N. Jingshu Liu Raheel Qader 😍 The paper « Améliorer la traduction au niveau du document grâce au sur-échantillonnage négatif et au masquage ciblé » (Improve document-level machine translation using negative-sampling and focused-masking) published during the French conference JEP-#TALN describes strategies we explored at Lingua Custodia to make the most of our sentence-level data. 👨🔬 Our research proposes alternative strategies to teach neural networks to extract contextual information as this helps to optimise the quality of the translated text.  👩🔬 We explored two methods, 1) negative-sampling and 2) masking highly contextual words in the source sentence, both of which improved contextual-awareness of the models.  Our future research will explore the capacity of Large Language Models (LLM) to handle large contexts, not only for translation, but also for RAG systems. 🙌 We will finetune the best LLM on high quality data and also leverage the European Datacentre "Leonardo" (thank you AI BOOST 😊 ) to train, from scratch, a multilingual LLM based on the Mamba architecture. 💪 #rag #llm #research #ai #foundationmodel

Tech Angels! 🤗 Olivier Debeugny and Matthias Verbeke We thoroughly enjoyed the TechQuartier Accelerator Digital Finance program and many, many thanks to the TechQuartier team. 😍 Our key highlights? Frederic Moioli Inspiring and vibrant atmosphere fuelled by smart people with a wide range of topics. Thoroughly enjoyed all the discussions, but particularly found the Embedded finance session, very interesting. 🙌 Olivier Debeugny Dynamic and supportive environment. The sessions on fund raising and scaling were very relevant to Lingua Custodia's current business strategy. 💪 Wishing all the other participants a wonderful summer and every success with their innovative digital finance solutions. #fintech #digitalfinance #innovation #ai #europe #frankfurt Complidata fulfin 21X in3 Pigtie Bankify Tapline NYALA payactive Miss Moneypenny Technologies PACEUPinvest® GmbH Xaver Teylor AG b1.ai

Lingua Custodia has collaborated on its first research paper this year! 💃 Many congratulation to Mariam N., our PhD student, and the rest of the research team Université Grenoble Alpes and Swansea University for their paper which was presented at the #EAMT2024 annual conference. 🤗 Their research analysed different #visualisationtools to determine which ones help the human translators to better understand the process of Neural Machine Translation. They provide answers to the following questions:  ❔ Which tools provide #humantranslators with the most insights about how machine translation works?  ❔ Can these tools help them understand any errors in the #translation?  ❔ Are they useful during the translators' training and/or for daily professional use? The conclusion? The visualisation tools are useful and the the simplest tools seem to be the most useful for human translators. 👉 The research link is here: https://lnkd.in/evYBXfCB 👉 The hugging face link is here: https://lnkd.in/emA48HjC #research #neuralmachinetranslation #womenintech

Yesterday was a new milestone for Lingua Custodia. Our CEO Olivier Debeugny, together with our Head of Research Raheel Qader and Jean-Gabriel BARTHELEMY, a key member of our AI engineering team went to the European Commission in Brussels to pick up the Large AI Grand Challenge award. Lingua Custodia is one of four AI startups from Europe that will share a whopping €1 million and 8 million GPU computational hours, catapulting Europe’s leadership in AI development! This recognition allows us to access some of the world best supercomputers and it positionsLingua Custodia into the small group of companies with the expertise and resources to develop foundation large language models. Well done to all the Lingua Custodia team - you all made this possible. This is the link to the official press release from the Commission : https://lnkd.in/enh7PZyz This is our formal press release : https://lnkd.in/eZ_J2KTZ Thank you to our supportive ecosystems in France, Luxembourg and Germany: France FinTech, Finance Innovation, France Digitale, CroissancePlus, Le Village by CA Paris, APIL les French tech du NLP, Le Village by CA Luxembourg, The LHoFT - Luxembourg House of Financial Technology, Business Club France-Luxembourg, TechQuartier #aichallenge #EuropeanAI #EuropeanHPC #fintech

We have been delighted to welcome Hayder Bouaziz for a 6 month internship at the Lingua Custodia Lab (R&D) and asked him for his feedback so far. ❔ What are you currently working on? I am currently developing a vision model designed to extract the layout of financial documents. This model aims to precisely segment these documents, thereby enhancing their subsequent processing. This project is part of a broader company initiative to integrate visual capabilities into language models (LMs). The integration of these capabilities will not only improve the accuracy and efficiency of document processing but also enable more sophisticated interactions with financial data. 🔬 🙌 ❔ Has Lingua Custodia met your expectations? 🤞 My experience at Lingua Custodia has surpassed my expectations both professionally and personally. It is incredibly exciting to join the passionate team at the Lab, who are working at the cutting edge of AI technology, and to learn alongside them. Their collaborative spirit and willingness to share knowledge have greatly enriched my learning experience, and I am inspired by their dedication and expertise. 🎊 🤗 ❔ How will this stage help you with your future career plans? My internship at Lingua Custodia has allowed me to immerse myself in the exciting and rapidly evolving world of AI. This experience has enabled me to acquire new skills by tackling diverse challenges. The knowledge and expertise I've gained here will be invaluable for the rest of my career. Additionally, working alongside such a talented and driven team has inspired me to continue pushing the boundaries of what is possible in the field of AI. 💪 😍 #research #llm #internship #ai #fintech #france

#nexus2050 is now fully launched!! If you re around , come and grab a coffee! Lingua Custodia is welcoming you booth 11

We were delighted to attend the Language Data Space Workshop, organised by Luxembourg Institute of Science and Technology (LIST), at Luxembourg on Wednesday 19th June. Frederic Moioli Raheel Qader Our 30 minute presentation focused on 'Training large scale decoders for multilingual machine translation' 💪 🕺 We very much enjoyed the other presentations and discussions which highlighted the inherent risk of bias in LLMs. Many thanks to Dimitra Anastasiou and Jordi Cabot for organising this workshop! #llms #bias #diversity #machinetranslation #research #fintech

Paris, Frankfurt and now Luxembourg! 😍 #europe 🎉 Delighted to announce that we will be present at #NEXUS2050, the tech fair in Luxembourg, under the banner of Le Village by CA Luxembourg. We are thrilled to be able to connect with this dynamic entrepreneurial ecosystem and meet our peers during these two days. 🤝👥 We will be at stand H16 on June 26th so please do come and see us! 🤗 Looking forward to seeing you there! #NEXUS2050 #VillagebyCALuxembourg #TechFair #Entrepreneurship #Networking

🙌 Reminder! Our conference 'Gen AI is not Sci-fi' which we are organising with Cosmian, at Le Village by CA Paris is taking place next week. We would be delighted if you can attend! The topics we will discuss include #llms #ai #datasecurity 😍 📅 Tuesday 18th June ⏲ 17h30 - 19h 🏠 55 Rue La Boétie, 75008, Paris 👉 Inscription link: https://bit.ly/3XEGwFR #genai #innovation #frenchtech

🙌 Lingua Custodia a le plaisir de vous inviter à une conférence sur l'IA générative 'Generative AI is not Sci-fi' le 18 juin à  17h30,  que nous co-organisons avec Cosmian chez Le Village by CA Paris ℹ Au cours de cette conférence, nous discuterons des avantages et des limites de l'IA générative. ℹ Nous illustrerons ces aspects et le retour sur investissement de cette technologie avec des cas d'usage liés au traitement des documents financiers et à la cybersécurité. Rejoignez-nous!