20.04 – Ubuntu 18.04 and 800+ devices

I have a storage that consist of server and 3 storages, each has 60 disks and 2 sas-controllers. There is two sas-controllers in server itself, so every disk is available by 4 routes. Like this:

enter image description here

To manage all disks I am using multipath, also I have two disks inside server in raid1 and lvm for root, boot and other system partitions.

So the problem is: before I had only 2 storages and everything worked fine, but later I added one more and after that ubuntu doesn’t boot anymore if storages is connected. There is timeouts like “waiting for device dev-mapper-vg00-boot” or “waiting for device dev-mapper-vg00-root” or something about udev and lvm2 (like lvm2-monitoring service). I believe that this is happens because there is too much devices.
Also I can’t reinstall system: 20.04 installer just crashes, 18.04 old debian style installer take ages to read disks. But somehow resque system is working, so I can get access to files and fix something.
I already tried to remove everything from fstab except boot and root partitions, I also filtered devices in /etc/lvm/lvm.conf so lvs/pvs and other commands runs much faster.
But I can’t fix that issue with that. What could cause problem in my case, what I can do to fix that?

How do I open Hauppauge WinTV in ubuntu 18.04?

How do I open Hauppauge WinTV in ubuntu 18.04?
This same question was asked with no answer by Chris Hutton on Nov. 22, 2019 at:
Hauppauge WinTV-dualHD not working on ubuntu 18.04
So, I’m asking again.
Like Chris, I followed the Install WinTV on Ubuntu HWE version installation instructions from this page:
Source: https://hauppauge.com/pages/support/support_linux.html
Everything seemed to install without any errors.
When it was all finished there it sat and still sets since 3-18-2020.
I can’t find a way to open WinTV.
I’m not all that familiar with the linux jargon so please keep it in layman’s terms if someone does have an answer. I have followed all the links associated with this but cannot see an answer in any of them.
I have searched Activities but all it gives me are links to things I’ve saved on my computer about Hauppauge WinTV.
I just tried running the instructions from this page:
https://s3.amazonaws.com/hauppauge/linux/hdpvr2_linux_readme.txt
The first instruction is:
Extract hauppauge_hdpvr2_.tar.gz
For this guide the file was saved and extracted on Desktop.
But it does not tell you how to extract it?
So, I went ahead and ran these instructions thinking maybe these are the instructions they’re talking about:
Install build-essential
$ sudo apt-get install build-essential

Move to hauppauge folder on Desktop
$ cd Desktop
$ cd hauppauge_hdpvr2_
Got: bash: cd: hauppauge_hdpvr2_: No such file or directory
So I created the directory:
rob@rob-MS-7721:~/Desktop$ mkdir hauppauge_hdpvr2_
rob@rob-MS-7721:~/Desktop$ cd hauppauge_hdpvr2_
rob@rob-MS-7721:~/Desktop/hauppauge_hdpvr2_$
and continued…

Copy file 99-Hauppauge-PVR2.rules

$ sudo cp 99-Hauppauge-PVR2.rules /etc/udev/rules.d/
Got:
cp: cannot stat ’99-Hauppauge-PVR2.rules’: No such file or directory
rob@rob-MS-7721:~/Desktop$ make
make: *** No targets specified and no makefile found. Stop.
I could see this was useless and Stopped.

Is there a driver I need? If so, how do I know what one?
This page shows a bunch of drivers but not what they are for?
https://hauppauge.com/pages/support/support_linux.html#hdpvr2

Thanks for any help you can provide,
Rob

composer – Drupal 8, cannot install Symfony Vardumper component (Ubuntu 16) Drupal 8.9.2

I am having issues installing symfony/var-dumper package via composer
the command I ran is

composer require symfony/var-dumper

The result I get is

Your requirements could not be resolved to an installable set of packages.

Problem 1
   - Conclusion: remove drupal/core-recommended 8.9.1
   - Conclusion: don't install drupal/core-recommended 8.9.1
   - Conclusion: don't install symfony/var-dumper v5.1.2
   - Conclusion: don't install symfony/var-dumper v5.1.1
   - Conclusion: don't install symfony/var-dumper v5.1.0
   - Conclusion: don't install symfony/var-dumper v5.1.0-RC2
   - Conclusion: don't install symfony/var-dumper v5.1.0-RC1
   - Conclusion: don't install symfony/var-dumper v5.1.0-BETA1
   - Installation request for drupal/core-recommended (locked at 8.9.1, required as ^8.8) -> satisfiable by drupal/core-recommended(8.9.1).
   - Conclusion: don't install symfony/var-dumper 5.2.x-dev
   - drupal/core-recommended 8.9.1 requires symfony/console v3.4.41 -> satisfiable by symfony/console(v3.4.41).
   - symfony/console v3.4.41 conflicts with symfony/var-dumper(5.1.x-dev).
   - symfony/var-dumper 5.1.x-dev conflicts with symfony/console(v3.4.41).
   - symfony/var-dumper 5.1.x-dev conflicts with symfony/console(v3.4.41).
   - Installation request for symfony/var-dumper ^5.1 -> satisfiable by symfony/var-dumper(5.1.x-dev, 5.2.x-dev, v5.1.0, v5.1.0-BETA1, v5.1.0-RC1, v5.1.0-RC2, v5.1.1, v5.1.2).
   Installation failed, reverting ./composer.json to its original content.

My composer.json file is

{
  "name": "drupal/legacy-project",
  "description": "Project template for Drupal 8 projects with composer following drupal/drupal layout",
  "type": "project",
  "license": "GPL-2.0-or-later",
  "homepage": "https://www.drupal.org/project/drupal",
  "support": {
    "docs": "https://www.drupal.org/docs/user_guide/en/index.html",
    "chat": "https://www.drupal.org/node/314178"
},
  "repositories": {
    "0": {
        "type": "composer",
        "url": "https://packages.drupal.org/8"
    },
    "drupal": {
        "type": "composer",
        "url": "https://packages.drupal.org/8"
    }
},
  "require": {
    "composer/installers": "^1.2",
    "drupal/core-composer-scaffold": "^8.8",
    "drupal/core-project-message": "^8.8",
    "drupal/core-recommended": "^8.8",
    "drupal/core-vendor-hardening": "^8.8",
    "phpmailer/phpmailer": "^6.1"
},
  "conflict": {
    "drupal/drupal": "*"
},
  "minimum-stability": "dev",
   "prefer-stable": true,
   "config": {
    "sort-packages": true
},
  "extra": {
    "drupal-scaffold": {
        "locations": {
            "web-root": "./"
        }
    },
    "installer-paths": {
        "core": (
            "type:drupal-core"
        ),
        "libraries/{$name}": (
            "type:drupal-library"
        ),
        "modules/contrib/{$name}": (
            "type:drupal-module"
        ),
        "profiles/contrib/{$name}": (
            "type:drupal-profile"
        ),
        "themes/contrib/{$name}": (
            "type:drupal-theme"
        ),
        "drush/Commands/contrib/{$name}": (
            "type:drupal-drush"
        ),
        "modules/custom/{$name}": (
            "type:drupal-custom-module"
        ),
        "themes/custom/{$name}": (
            "type:drupal-custom-theme"
        )
    },
    "drupal-core-project-message": {
        "include-keys": (
            "homepage",
            "support"
        ),
        "post-create-project-cmd-message": (
            "<bg=blue;fg=white>                                                         </>",
            "<bg=blue;fg=white>  Congratulations, you’ve installed the Drupal codebase  </>",
            "<bg=blue;fg=white>  from the drupal/legacy-project template!               </>",
            "<bg=blue;fg=white>                                                         </>",
            "",
            "<bg=yellow;fg=black>Next steps</>:",
            "  * Install the site: https://www.drupal.org/docs/8/install",
            "  * Read the user guide: https://www.drupal.org/docs/user_guide/en/index.html",
            "  * Get support: https://www.drupal.org/support",
            "  * Get involved with the Drupal community:",
            "      https://www.drupal.org/getting-involved",
            "  * Remove the plugin that prints this message:",
            "      composer remove drupal/core-project-message"
        )
    }
}
}

I haven’t even customized it yet, this is pretty much out of the box at the moment and I am already having issues.

boot – Is there a way to install ubuntu by copying files to the disk?

I’ve tried to install ubuntu on my pen drive several times and always get the same error during installation that says “Attempt to mount a filesystem with type ext4 at ‘/’ failed”, or something like it. I’ve tried to work around this problem for some time, tried all possible ways to install ubuntu and the result was always the same. I wnat to know if there’s a way to just copy the files from a machine with ubuntu full installed to the removable device, and then make the device bootable. Like a direct install, copy the necessary files to pen drive and make it work. Is there any way to do that ? Any help would be appreciated

X11 configuration on Ubuntu 18.04. Worked on Ubuntu 16.04

Here is a script which is run in cron for user1 who has sudo privileges

   export DISPLAY=:0 
   export XAUTHORITY=/home/user2/.Xauthority 
   scrot -q 30 "/tmp/%Y-%m-%d-%H-%M_screen.jpg" 2>/tmp/err
 

It worked fine on Ubuntu 16.04. When upgraded to 18:04, it gives the error: Invalid MIT-MAGIC-COOKIE-1 keygiblib error: Can’t open X display. It is running, yeah?

File .Xauthority is owned by user2, group owned by user1 and has permissions 660.

What changed between Ubuntu 16:04 and 18:04? I tried export DISPLAY=:1.0 instead of export DISPLAY=:0 after reading a post on SO. It gave this error: giblib error: Can’t open X display. It is running, yeah?

drivers – Brother DCP-T510w prints, but don’t scan, Ubuntu 20.04, How can I make xsane recognise it?

I used my printer with ease back in Ubuntu 18.04, but i had to upgrade it. The System works fine and installed all drivers from DCP-T510w Brother’s page. The Printer works fine, although sometimes I have to make some roundabout way to do it, but the scanner doesn’t work. Document scanner and xsane doesn’t recognise it.
I saw a dozen forums about similar problems, but they seemed complicated and without standard. none concerning Ubuntu 20.04.

Here are some information, I could gather about the drivers

[scanimage and brother drivers1
and sane find scan

networking – persistent ethernet disconnections on ubuntu 20.04

I am running Ubuntu 20.04 and I am using a wired ethernet connection.

I’ve been suffering from regular internet drops (the network icon on the top right toolbar dissapears) for 5-10 seconds. The wifi on my laptop continues working throughout the period of connection outage. When the intenet is working, it is running fine at ~100Mb/s.

I have tried following the advice here, but the problem persists.

lscpu

Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   39 bits physical, 48 bits virtual
CPU(s):                          8
On-line CPU(s) list:             0-7
Thread(s) per core:              2
Core(s) per socket:              4
Socket(s):                       1
NUMA node(s):                    1
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           94
Model name:                      Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
Stepping:                        3
CPU MHz:                         800.079
CPU max MHz:                     4000.0000
CPU min MHz:                     800.0000
BogoMIPS:                        6799.81
Virtualisation:                  VT-x
L1d cache:                       128 KiB
L1i cache:                       128 KiB
L2 cache:                        1 MiB
L3 cache:                        8 MiB
NUMA node0 CPU(s):               0-7
Vulnerability Itlb multihit:     KVM: Mitigation: Split huge pages
Vulnerability L1tf:              Mitigation; PTE Inversion; VMX conditional cach
                                 e flushes, SMT vulnerable
Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT vulnerable
Vulnerability Meltdown:          Mitigation; PTI
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled v
                                 ia prctl and seccomp
Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user
                                  pointer sanitization
Vulnerability Spectre v2:        Mitigation; Full generic retpoline, IBPB condit
                                 ional, IBRS_FW, STIBP conditional, RSB filling
Vulnerability Srbds:             Mitigation; Microcode
Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT vulnerable
Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtr
                                 r pge mca cmov pat pse36 clflush dts acpi mmx f
                                 xsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rd
                                 tscp lm constant_tsc art arch_perfmon pebs bts 
                                 rep_good nopl xtopology nonstop_tsc cpuid aperf
                                 mperf pni pclmulqdq dtes64 monitor ds_cpl vmx s
                                 mx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid s
                                 se4_1 sse4_2 x2apic movbe popcnt tsc_deadline_t
                                 imer aes xsave avx f16c rdrand lahf_lm abm 3dno
                                 wprefetch cpuid_fault epb invpcid_single pti ss
                                 bd ibrs ibpb stibp tpr_shadow vnmi flexpriority
                                  ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle a
                                 vx2 smep bmi2 erms invpcid rtm mpx rdseed adx s
                                 map clflushopt intel_pt xsaveopt xsavec xgetbv1
                                  xsaves dtherm ida arat pln pts hwp hwp_notify 
                                 hwp_act_window hwp_epp md_clear flush_l1d

lspci

00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers (rev 07)
00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe Controller (x16) (rev 07)
00:02.0 Display controller: Intel Corporation HD Graphics 530 (rev 06)
00:14.0 USB controller: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller
00:14.2 Signal processing controller: Intel Corporation 200 Series PCH Thermal Subsystem
00:15.0 Signal processing controller: Intel Corporation 200 Series PCH Serial IO I2C Controller #0
00:16.0 Communication controller: Intel Corporation 200 Series PCH CSME HECI #1
00:16.3 Serial controller: Intel Corporation Device a2bd
00:17.0 SATA controller: Intel Corporation 200 Series PCH SATA controller (AHCI mode)
00:1b.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #17 (rev f0)
00:1c.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #4 (rev f0)
00:1d.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port #9 (rev f0)
00:1f.0 ISA bridge: Intel Corporation 200 Series PCH LPC Controller (Q270)
00:1f.2 Memory controller: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller
00:1f.3 Audio device: Intel Corporation 200 Series PCH HD Audio
00:1f.4 SMBus: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (5) I219-LM
01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. (AMD/ATI) Oland (Radeon HD 8570 / R7 240/340 / Radeon 520 OEM) (rev 87)
01:00.1 Audio device: Advanced Micro Devices, Inc. (AMD/ATI) Oland/Hainan/Cape Verde/Pitcairn HDMI Audio (Radeon HD 7000 Series)
02:00.0 Non-Volatile memory controller: Toshiba Corporation Device 0116
03:00.0 PCI bridge: Texas Instruments XIO2001 PCI Express-to-PCI Bridge
05:00.0 VGA compatible controller: Advanced Micro Devices, Inc. (AMD/ATI) Oland (Radeon HD 8570 / R7 240/340 / Radeon 520 OEM) (rev 87)
05:00.1 Audio device: Advanced Micro Devices, Inc. (AMD/ATI) Oland/Hainan/Cape Verde/Pitcairn HDMI Audio (Radeon HD 7000 Series)

sudo lshw -C network

  *-network                 
       description: Ethernet interface
       product: Ethernet Connection (5) I219-LM
       vendor: Intel Corporation
       physical id: 1f.6
       bus info: pci@0000:00:1f.6
       logical name: enp0s31f6
       version: 00
       serial: 8c:ec:4b:6b:16:43
       size: 100Mbit/s
       capacity: 1Gbit/s
       width: 32 bits
       clock: 33MHz
       capabilities: pm msi bus_master cap_list ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
       configuration: autonegotiation=on broadcast=yes driver=e1000e driverversion=3.2.6-k duplex=full firmware=0.1-4 ip=192.168.0.17 latency=0 link=yes multicast=yes port=twisted pair speed=100Mbit/s
       resources: irq:128 memory:ee200000-ee21ffff

networking – Pop OS / Ubuntu 20.04; No network interfaces anymore

I installed Pop OS a while ago. Everything work fine.

A few days ago, I open my Laptop and my internet connection is lost. I check all settings and realize, that my network devices are lost in the configurations.

No network devices

When I boot with an installation stick, the devices are visible

wired interface

wifi interface

How can I get the devices back to my config?
I try a lot of tipps, but nothing works.

Here some additional infos:

    ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether 84:a9:3e:44:7a:ad brd ff:ff:ff:ff:ff:ff
    inet 192.168.0.241/24 brd 192.168.0.255 scope global dynamic enp1s0
       valid_lft 5248sec preferred_lft 5248sec
    inet6 fe80::86a9:3eff:fe44:7aad/64 scope link 
       valid_lft forever preferred_lft forever
3: wlp2s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether d8:9c:67:24:4b:e7 brd ff:ff:ff:ff:ff:ff



sudo lshw -class network
  *-network                 
       Beschreibung: Ethernet interface
       Produkt: RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
       Hersteller: Realtek Semiconductor Co., Ltd.
       Physische ID: 0
       Bus-Informationen: pci@0000:01:00.0
       Logischer Name: enp1s0
       Version: 15
       Seriennummer: 84:a9:3e:44:7a:ad
       Größe: 1Gbit/s
       Kapazität: 1Gbit/s
       Breite: 64 bits
       Takt: 33MHz
       Fähigkeiten: pm msi pciexpress msix bus_master cap_list ethernet physical tp mii 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation
       Konfiguration: autonegotiation=on broadcast=yes driver=r8169 duplex=full firmware=rtl8168h-2_0.0.2 02/26/15 ip=192.168.0.241 latency=0 link=yes multicast=yes port=MII speed=1Gbit/s
       Ressourcen: irq:19 ioport:4000(Größe=256) memory:b1204000-b1204fff memory:b1200000-b1203fff
  *-network DEAKTIVIERT
       Beschreibung: Kabellose Verbindung
       Produkt: RTL8723DE 802.11b/g/n PCIe Adapter
       Hersteller: Realtek Semiconductor Co., Ltd.
       Physische ID: 0
       Bus-Informationen: pci@0000:02:00.0
       Logischer Name: wlp2s0
       Version: 00
       Seriennummer: d8:9c:67:24:4b:e7
       Breite: 64 bits
       Takt: 33MHz
       Fähigkeiten: pm msi pciexpress bus_master cap_list ethernet physical wireless
       Konfiguration: broadcast=yes driver=rtw_pci driverversion=5.4.0-7634-generic firmware=N/A latency=0 link=no multicast=yes wireless=IEEE 802.11
       Ressourcen: irq:135 ioport:3000(Größe=256) memory:b1100000-b110ffff

With “sudo dhclient -v enpls0” I got the wired connection working, but it’s very slow (max 3 MBit).

ubuntu – 7zip Header Error when using 7z in bash

within a shell script (ubuntu 20.x), a file (GeoPackage) is created and then packed in a zip-archive with 7zip. Afterwards, the zip-archive will be uploaded to a FTP-server. I had problems with corrupt zip-archives, because the bash starts the commands not line by line within the script, but right away the next line when the line before is executet.

My first solution: implementing the wait-command. It works for all commands within my script, but 7zip still produces corrupt archives regarding header errors.

Not a good solution: The only solution here is to start the archiving process outside the shell script. But this is not suitable for the workflow, because the files are large and cannot be stored till the end of all archiving processes.

This is a snippet of the script, I’m running:

7z a -tzip -mmt=on -mx=1 /directory/File.zip /directory/File.gpkg & pid=$!
wait $pid
rm /directory/File.gpkg
wput -u *.zip ftp://filesever.net & pid=$!
wait $pid
rm /directory/*.zip

The error from 7zip when extracting the file is:

Errors: Headers Error Unconfirmed start of archive
Warnings: There are some data after the end of the payload data

This is a sample file:

https://download.osmdata.xyz/data/geological_EPSG4326.zip

Is there a way to prevent such errors?