{"abstract":[{"lang":"eng","text":"Threats to user privacy in Web 2.0 are abundant and can arise from various sources, including texts, geoinformation,\r\nimages, videos, or combinations of these. To alert users of potential threats, it is crucial to gather all relevant information. However, aggregating user-specific information from various web platforms, including social networks, can be challenging due to the vast amount of data available, as well as issues with data quality and the numerous possible variants. This paper examines the capability of current Vision-Language Models to accurately identify relevant image data and extract sensitive information. To accomplish this, we developed our own dataset with diverse\r\nexpressions for privacy attributes, based on the VISPR dataset. Furthermore, we address the challenge of synthetic images of people and its impact on our approach. Our findings suggest that these models are effective in pre-selecting relevant images, but there are limitations in information extraction. \r\nKeywords—Computer Vision; Privacy; Social Networks"}],"language":[{"iso":"eng"}],"main_file_link":[{"open_access":"1","url":"https://www.iariajournals.org/security/tocv17n12.html"}],"volume":17,"publication_status":"published","type":"journal_article","year":"2024","title":"Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction","citation":{"bibtex":"@article{Schultenkämper_Bäumer_2024, title={Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction}, volume={17}, number={1+2}, journal={International Journal On Advances in Security}, publisher={IARIA XPS Press}, author={Schultenkämper, Sergej and Bäumer, Frederik S.}, year={2024}, pages={1–10} }","mla":"Schultenkämper, Sergej, and Frederik S. Bäumer. “Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction.” <i>International Journal On Advances in Security</i>, vol. 17, no. 1+2, IARIA XPS Press, 2024, pp. 1–10.","short":"S. Schultenkämper, F.S. Bäumer, International Journal On Advances in Security 17 (2024) 1–10.","alphadin":"<span style=\"font-variant:small-caps;\">Schultenkämper, Sergej</span> ; <span style=\"font-variant:small-caps;\">Bäumer, Frederik S.</span>: Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction. In: <i>International Journal On Advances in Security</i> Bd. 17, IARIA XPS Press (2024), Nr. 1+2, S. 1–10","chicago":"Schultenkämper, Sergej, and Frederik S. Bäumer. “Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction.” <i>International Journal On Advances in Security</i> 17, no. 1+2 (2024): 1–10.","apa":"Schultenkämper, S., &#38; Bäumer, F. S. (2024). Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction. <i>International Journal On Advances in Security</i>, <i>17</i>(1+2), 1–10.","ama":"Schultenkämper S, Bäumer FS. Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction. <i>International Journal On Advances in Security</i>. 2024;17(1+2):1-10.","ieee":"S. Schultenkämper and F. S. Bäumer, “Pixels versus Privacy: Leveraging Vision-Language Models for Sensitive Information Extraction,” <i>International Journal On Advances in Security</i>, vol. 17, no. 1+2, pp. 1–10, 2024."},"issue":"1+2","status":"public","_id":"4454","project":[{"name":"Institute for Data Science Solutions","_id":"f432a2ee-bceb-11ed-a251-a83585c5074d"}],"article_type":"original","oa":"1","publisher":"IARIA XPS Press","author":[{"first_name":"Sergej","id":"236164","full_name":"Schultenkämper, Sergej","last_name":"Schultenkämper","orcid_put_code_url":"https://api.orcid.org/v2.0/0009-0005-6858-9813/work/164356029","orcid":"0009-0005-6858-9813"},{"first_name":"Frederik S.","id":"241734","full_name":"Bäumer, Frederik S.","orcid":"0000-0002-0826-0144","orcid_put_code_url":"https://api.orcid.org/v2.0/0000-0002-0826-0144/work/164356030","last_name":"Bäumer"}],"user_id":"220548","page":"1-10","quality_controlled":"1","publication_identifier":{"issn":["1942-2636"]},"intvolume":"        17","date_created":"2024-04-08T13:23:09Z","date_updated":"2024-07-26T09:31:58Z","publication":"International Journal On Advances in Security"}