Duplicate sources aren't detected if one conforms to Debian's new package source format

[XTRXTRPI]

From Askubuntu

Ubuntu sources have moved to /etc/apt/sources.list.d/ubuntu.sources

I'm guessing this file is no longer used in 24.04 LTS.
The fix, python script listed on AskUbuntu no longer appears to be valid
I was trying to clean up my source list from a non free and a stable version of Opera.
Result Failed

I know the python script is old at this point but I thought I would try it.

I followed the steps on AskUbuntu page linked above

Here is terminal output:

x@x-HP:~/Downloads$ cd aptsources-cleanup
x@x-HP:~/Downloads/aptsources-cleanup$ ls
aptsources-cleanup.pyz
x@x-HP:~/Downloads/aptsources-cleanup$ chmod a+x aptsources-cleanup.pyz
x@x-HP:~/Downloads/aptsources-cleanup$ sudo ./aptsources-cleanup.pyz
No duplicate entries were found.

“/etc/apt/sources.list” contains no valid and enabled repository lines.
Do you want to remove it?  (yes/no/all/none/display)
? n

0 of 1 empty sourcelist files removed.

Thank you for your time and effort in creating the aptsources-cleanup script

[XTRXTRPI]

I did verify that the most current python was installed prior to installing and running your script
Here is the terminal output:

x@x-HP:~$ sudo apt install python3-apt
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
python3-apt is already the newest version (2.7.7ubuntu5).
python3-apt set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

Once again thanks for your effort and time to create the script.

[davidfoerster]

Could you please provide the sources.list file(s) that contain the duplicate source listings? I'll take a look to see what's the issue, whether that is a shortcoming with this little script or an oversight or misunderstanding on your end.

[XTRXTRPI]

This was my original output of sudo apt update:

Hit:1 https://dl.google.com/linux/chrome/deb stable InRelease
Hit:2 http://us.archive.ubuntu.com/ubuntu noble InRelease                      
Hit:3 http://us.archive.ubuntu.com/ubuntu noble-updates InRelease              
Hit:4 https://deb.opera.com/opera-stable stable InRelease                      
Hit:5 http://us.archive.ubuntu.com/ubuntu noble-backports InRelease 
Hit:6 http://security.ubuntu.com/ubuntu noble-security InRelease
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
All packages are up to date.
N: Skipping acquire of configured file 'main/binary-i386/Packages' as repository 'https://dl.google.com/linux/chrome/deb stable InRelease' doesn't support architecture 'i386'
W: Target Packages (non-free/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Packages (non-free/binary-i386/Packages) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Packages (non-free/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Translations (non-free/i18n/Translation-en_US) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Translations (non-free/i18n/Translation-en) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11 (non-free/dep11/Components-amd64.yml) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11 (non-free/dep11/Components-all.yml) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11-icons-small (non-free/dep11/icons-48x48.tar) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11-icons (non-free/dep11/icons-64x64.tar) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11-icons-hidpi (non-free/dep11/icons-64x64@2.tar) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target CNF (non-free/cnf/Commands-amd64) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target CNF (non-free/cnf/Commands-all) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Packages (non-free/binary-amd64/Packages) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Packages (non-free/binary-i386/Packages) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Packages (non-free/binary-all/Packages) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Translations (non-free/i18n/Translation-en_US) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target Translations (non-free/i18n/Translation-en) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11 (non-free/dep11/Components-amd64.yml) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11 (non-free/dep11/Components-all.yml) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11-icons-small (non-free/dep11/icons-48x48.tar) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11-icons (non-free/dep11/icons-64x64.tar) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target DEP-11-icons-hidpi (non-free/dep11/icons-64x64@2.tar) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target CNF (non-free/cnf/Commands-amd64) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
W: Target CNF (non-free/cnf/Commands-all) is configured multiple times in /etc/apt/sources.list.d/opera-stable.list:4 and /etc/apt/sources.list.d/opera-stable.sources:1
N: Missing Signed-By in the sources.list(5) entry for 'https://deb.opera.com/opera-stable'

Then I tried to see the sources list:

# Ubuntu sources have moved to /etc/apt/sources.list.d/
ubuntu.sources

The output to sudo apt update was still as above so I thought I would try your python script:
first verifying the current python files were present as you suggested in the AskUbuntu question linked in first post here.
The output is also listed above in the first post above.

The issue is solved at this point but I still have terminal history on. I looked at the Other Software tab inside Software Settings of the Software Updater and found the 'non free' entry and unchecked it, this forced a reload when I hit close.

Here is the current output of sudo apt update:

Hit:1 https://dl.google.com/linux/chrome/deb stable InRelease
Hit:2 http://us.archive.ubuntu.com/ubuntu noble InRelease                                                                                        
Hit:3 https://deb.opera.com/opera-stable stable InRelease                                                                                        
Hit:4 http://us.archive.ubuntu.com/ubuntu noble-updates InRelease                                      
Hit:5 http://security.ubuntu.com/ubuntu noble-security InRelease                                       
Hit:6 http://us.archive.ubuntu.com/ubuntu noble-backports InRelease                                    
Hit:7 https://ppa.launchpadcontent.net/flatpak/stable/ubuntu noble InRelease     
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
3 packages can be upgraded. Run 'apt list --upgradable' to see them.
N: Skipping acquire of configured file 'main/binary-i386/Packages' as repository 'https://dl.google.com/linux/chrome/deb stable InRelease' doesn't support architecture 'i386'

I do not understand the N: Skipping but I currently researching it. I also added the new Flatpak PPA since some of my flatpak software is out of date.

Happy to help or learn if there was something I did not understand. Thank you for your time and effort David.

[davidfoerster]

Could you please also post your /etc/apt/sources.list.d/opera-stable.sources? You can (usually) attach text files to GitHub comments rather than pasting long code listings in-line. (GitHub's comment system is a bit picky with file extensions though. You may need to copy the file to one named opera-stable.sources.txt first; note the additional file extension.)

N: Skipping acquire of configured file 'main/binary-i386/Packages' as repository 'https://dl.google.com/linux/chrome/deb stable InRelease' doesn't support architecture 'i386'

I do not understand the N: Skipping but I currently researching it.

It means that something added the Google Chrome package repository for 32-bit Intel instruction architecture ("i386") but Google hasn't released i386 builds of Chrome in a long time and thus there's no such package repository. And Canonical dropped support for i386 a couple of years ago too.

[XTRXTRPI]

Okay here is the opera stable sources file you requested.
Thanks for looking into it.

opera-stable-sources.txt

[davidfoerster]

Thanks! I forgot to request the other relevant file: /etc/apt/sources.list.d/opera-stable.list. Could you please provide that one too?

[XTRXTRPI]

Sorry for the late response, my eyes deceived me. I thought you were asking for the same file, my apologies.

opera-stable.list.txt

[davidfoerster]

I see. Debian appears to have introduced a new package repository source format and you have configured the same repository with both the old and the new format. (Maybe it was automatically converted with retention of the original in case of errors or distro downgrades.) Thus the duplicate entry.

I suggest that you simply remove /etc/apt/sources.list.d/opera-stable.list since the source format migration is likely a one-time issue. Could you please do that and report the result?

[XTRXTRPI]

I removed /etc/apt/sources.list.d/opera-stable.list I attached before and after txt files showing terminal output if each

ls After opera-stable.list.txt
ls before opera-stable.list.txt

Opera appears to function properly however the Opera stable ppa is no longer listed in the Other Software tab of Software Updater.
here is the output of sudo apt update now

Apt Update Output.txt

Looks good though off topic I'm still trying to figure out how to fix that N: skipping ...i386 google chrome line out of it.

[davidfoerster]

I'm still trying to figure out how to fix that N: skipping ...i386 google chrome line out of it.

https://askubuntu.com/q/741410/175814 looks very applicable.

[XTRXTRPI]

Thank you for that askubuntu link, I reviewed it quickly and it seems you are correct I just need to perform the steps in the solution.