You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 19:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun Jun 07, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8874993434,0cyclictest9087-21lspci12:23:191
8884991918,1cyclictest65850irq/126-lan07:45:143
8884991818,0cyclictest65850irq/126-lan10:20:183
8884991817,1cyclictest65850irq/126-lan10:40:163
8884991717,0cyclictest65850irq/126-lan12:16:293
8884991717,0cyclictest65850irq/126-lan10:30:193
8884991717,0cyclictest65850irq/126-lan08:20:163
8884991717,0cyclictest65850irq/126-lan07:35:193
8884991716,1cyclictest65850irq/126-lan12:35:143
8884991716,1cyclictest65850irq/126-lan11:30:183
8884991716,1cyclictest65850irq/126-lan11:15:223
8884991716,1cyclictest65850irq/126-lan09:19:273
8884991716,1cyclictest65850irq/126-lan09:00:143
8884991616,0cyclictest65850irq/126-lan12:30:133
8884991616,0cyclictest65850irq/126-lan12:25:163
8884991616,0cyclictest65850irq/126-lan11:55:123
8884991616,0cyclictest65850irq/126-lan09:55:203
8884991616,0cyclictest65850irq/126-lan08:14:273
8884991616,0cyclictest65850irq/126-lan07:27:563
8884991615,1cyclictest65850irq/126-lan12:20:203
8884991615,1cyclictest65850irq/126-lan12:05:143
8884991615,1cyclictest65850irq/126-lan11:20:133
8884991615,1cyclictest65850irq/126-lan10:37:223
8884991615,1cyclictest65850irq/126-lan10:27:283
8884991615,1cyclictest65850irq/126-lan08:50:183
8884991615,1cyclictest65850irq/126-lan07:10:193
8884991515,0cyclictest65850irq/126-lan11:05:223
8884991515,0cyclictest65850irq/126-lan10:15:153
8884991515,0cyclictest65850irq/126-lan09:30:113
8884991515,0cyclictest65850irq/126-lan09:10:133
8884991515,0cyclictest65850irq/126-lan09:05:183
8884991515,0cyclictest65850irq/126-lan07:55:213
8884991514,1cyclictest65850irq/126-lan11:51:293
8884991514,1cyclictest65850irq/126-lan11:45:143
8884991514,1cyclictest65850irq/126-lan11:40:133
8884991514,1cyclictest65850irq/126-lan10:55:143
8884991514,1cyclictest65850irq/126-lan10:50:213
8884991514,1cyclictest65850irq/126-lan08:40:183
8884991514,1cyclictest65850irq/126-lan08:15:183
8884991514,1cyclictest65850irq/126-lan07:40:213
8884991414,0cyclictest65850irq/126-lan09:26:393
8884991414,0cyclictest65850irq/126-lan08:25:283
8884991414,0cyclictest65850irq/126-lan07:18:163
8884991413,1cyclictest65850irq/126-lan10:10:153
8884991413,1cyclictest65850irq/126-lan08:35:123
8884991413,1cyclictest65850irq/126-lan08:30:153
8884991313,0cyclictest65850irq/126-lan09:20:133
8884991313,0cyclictest65850irq/126-lan07:52:513
8884991313,0cyclictest65850irq/126-lan07:20:173
8884991312,1cyclictest65850irq/126-lan12:00:213
8884991312,1cyclictest65850irq/126-lan10:05:133
8884991312,1cyclictest65850irq/126-lan08:08:203
8884991312,1cyclictest65850irq/126-lan07:30:143
8884991212,0cyclictest65850irq/126-lan11:35:003
8884991211,1cyclictest65850irq/126-lan12:15:003
8884991211,1cyclictest65850irq/126-lan11:25:163
887999126,3cyclictest522-21avahi-daemon10:41:432
8884991111,0cyclictest65850irq/126-lan11:10:143
8884991110,1cyclictest65850irq/126-lan11:00:123
8884991110,1cyclictest65850irq/126-lan10:45:143
8884991110,1cyclictest65850irq/126-lan09:50:163
887499119,2cyclictest743-21snmpd11:28:361
888499109,1cyclictest65850irq/126-lan08:55:153
888499109,1cyclictest65850irq/126-lan08:00:123
8884991010,0cyclictest65850irq/126-lan09:38:343
8884991010,0cyclictest65850irq/126-lan08:45:153
887999108,2cyclictest741-21lldpd11:45:102
887999108,2cyclictest741-21lldpd10:46:332
887999108,2cyclictest741-21lldpd09:16:182
887999106,4cyclictest743-21snmpd08:38:422
88849999,0cyclictest65850irq/126-lan09:48:443
88849998,1cyclictest65850irq/126-lan10:00:183
88799998,1cyclictest743-21snmpd10:35:252
88799998,1cyclictest741-21lldpd10:56:402
88799996,3cyclictest23071-21gltestperf11:40:122
88799995,4cyclictest743-21snmpd12:32:412
88799995,4cyclictest743-21snmpd08:53:042
88799992,4cyclictest557-21NetworkManager07:55:342
88799990,4cyclictest10436-21needreboot09:50:152
88749998,1cyclictest743-21snmpd11:43:041
88749998,1cyclictest743-21snmpd10:11:241
88749998,1cyclictest743-21snmpd08:43:451
88749998,1cyclictest743-21snmpd08:15:231
88749998,1cyclictest743-21snmpd07:21:121
88749998,1cyclictest741-21lldpd10:38:531
88749998,1cyclictest741-21lldpd09:07:311
88669998,1cyclictest743-21snmpd09:05:340
88669998,1cyclictest743-21snmpd08:07:020
88799988,0cyclictest741-21lldpd10:32:132
88799987,1cyclictest743-21snmpd12:13:172
88799987,1cyclictest743-21snmpd07:27:582
88799987,1cyclictest10672-21fschecks_time12:25:122
88799986,2cyclictest743-21snmpd09:02:012
88799985,3cyclictest743-21snmpd09:49:242
88799985,3cyclictest741-21lldpd07:18:302
88799984,4cyclictest743-21snmpd08:32:302
88799983,2cyclictest20393-21sed08:55:202
88799982,3cyclictest557-21NetworkManager07:20:222
88799982,3cyclictest244-20systemd-journal09:05:532
88799982,2cyclictest22424-21grep07:40:222
88799981,3cyclictest25469-21grep07:50:132
88799981,3cyclictest2441-21ntpq09:30:152
88799981,3cyclictest18515-21grep10:10:132
88799980,3cyclictest9952-21open_files07:10:182
88799980,3cyclictest8798-21/usr/sbin/munin11:05:162
88799980,3cyclictest7850-21ntp_states08:25:162
88799980,3cyclictest7048-21ntp_states11:00:162
88799980,3cyclictest3822-21ntpq08:15:192
88799980,3cyclictest32564-21unixbench-2d08:05:222
88799980,3cyclictest22120-21entropy10:20:132
88799980,3cyclictest20686-21/usr/sbin/munin10:15:162
88799980,3cyclictest1651-21nfs_client08:10:172
88799980,3cyclictest14622-21ntpq10:00:152
88749988,0cyclictest743-21snmpd11:15:211
88749988,0cyclictest743-21snmpd10:21:371
88749988,0cyclictest743-21snmpd08:50:121
88749988,0cyclictest743-21snmpd07:26:371
88749988,0cyclictest741-21lldpd11:54:141
88749988,0cyclictest741-21lldpd11:39:421
88749988,0cyclictest741-21lldpd10:53:271
88749988,0cyclictest741-21lldpd07:10:501
88749987,1cyclictest743-21snmpd07:39:491
88749986,2cyclictest743-21snmpd12:09:141
88749986,2cyclictest743-21snmpd11:25:001
88749986,2cyclictest743-21snmpd10:55:201
88749986,2cyclictest743-21snmpd10:16:101
88749986,2cyclictest743-21snmpd09:11:281
88749986,2cyclictest743-21snmpd07:59:051
88669988,0cyclictest743-21snmpd12:25:260
88669988,0cyclictest743-21snmpd11:20:390
88669988,0cyclictest743-21snmpd07:36:310
88669988,0cyclictest741-21lldpd12:07:370
88669988,0cyclictest741-21lldpd09:41:070
88669988,0cyclictest741-21lldpd07:11:520
88669987,1cyclictest743-21snmpd10:15:490
88669987,1cyclictest743-21snmpd09:56:140
88669987,1cyclictest743-21snmpd09:50:330
88669987,1cyclictest741-21lldpd11:51:000
88669987,1cyclictest741-21lldpd11:45:480
88669987,1cyclictest522-21avahi-daemon09:30:170
88669986,2cyclictest743-21snmpd10:43:590
88669986,2cyclictest743-21snmpd09:16:200
88669986,2cyclictest743-21snmpd07:25:160
88799976,1cyclictest743-21snmpd10:52:082
88799976,1cyclictest522-21avahi-daemon10:05:062
88799975,2cyclictest522-21avahi-daemon08:46:132
88799972,2cyclictest743-21snmpd08:20:032
88799972,2cyclictest11875-21seq11:13:542
88799971,2cyclictest30807-21date12:00:002
88799971,2cyclictest29395-21sed11:55:152
88799971,2cyclictest14466-21cut11:20:132
88799970,3cyclictest6675-21apt-config12:20:002
88799970,3cyclictest6216-21if_lan09:40:132
88799970,3cyclictest4659-21/usr/sbin/munin12:15:122
88799970,3cyclictest4046-21fw_forwarded_lo09:35:142
88799970,3cyclictest377-21acpi12:05:122
88799970,3cyclictest32279-21df_inode09:25:102
88799970,3cyclictest30393-21/usr/sbin/munin09:20:102
88799970,3cyclictest30118-21ntpq08:00:162
88799970,3cyclictest24415-21irqstats10:25:142
88799970,3cyclictest19339-21/usr/sbin/munin07:35:132
88799970,3cyclictest18806-21/usr/sbin/munin11:30:112
88799970,3cyclictest18408-21grep07:30:202
88799970,3cyclictest17553-21ntp_states11:25:162
88799970,3cyclictest15669-21/usr/sbin/munin12:35:212
88799970,3cyclictest13273-21diskstats08:40:122
88799970,3cyclictest12411-21/usr/sbin/munin11:15:132
88799970,3cyclictest11814-21acpi09:55:112
88799970,2cyclictest26773-21/usr/sbin/munin11:50:132
88749977,0cyclictest743-21snmpd11:46:371
88749977,0cyclictest743-21snmpd09:24:231
88749977,0cyclictest743-21snmpd07:48:271
88749977,0cyclictest743-21snmpd07:40:161
88749977,0cyclictest741-21lldpd11:03:181
88749977,0cyclictest741-21lldpd08:21:391
88749977,0cyclictest522-21avahi-daemon09:28:171
88749976,1cyclictest743-21snmpd08:46:401
88749976,1cyclictest522-21avahi-daemon09:16:331
88749976,1cyclictest244-20systemd-journal12:28:301
88749976,1cyclictest24032-21cpuspeed_turbos10:25:111
88749975,2cyclictest743-21snmpd11:05:381
88749975,2cyclictest743-21snmpd09:36:531
88749975,2cyclictest743-21snmpd09:30:171
88749975,2cyclictest743-21snmpd08:56:071
88749975,2cyclictest743-21snmpd08:11:411
88749974,2cyclictest19158-21cat11:30:141
88669977,0cyclictest743-21snmpd11:33:070
88669977,0cyclictest743-21snmpd10:14:490
88669977,0cyclictest743-21snmpd09:35:380
88669977,0cyclictest743-21snmpd07:50:110
88669977,0cyclictest743-21snmpd07:47:010
88669977,0cyclictest741-21lldpd10:06:570
88669977,0cyclictest741-21lldpd09:02:260
88669977,0cyclictest522-21avahi-daemon09:45:080
88669976,1cyclictest743-21snmpd12:04:580
88669976,1cyclictest743-21snmpd08:36:470
88669976,1cyclictest743-21snmpd08:18:180
88669975,2cyclictest743-21snmpd11:11:060
88669975,2cyclictest743-21snmpd10:27:370
88669975,2cyclictest743-21snmpd08:33:420
88849961,4cyclictest7703-21cat09:45:003
88799960,3cyclictest21529-21ntpq11:35:162
88799960,2cyclictest26101-21/usr/sbin/munin09:10:112
88799960,2cyclictest23235-21/usr/sbin/munin07:45:112
88749965,1cyclictest743-21snmpd08:38:331
88749965,1cyclictest741-21lldpd07:30:341
88749965,1cyclictest25569-21gltestperf07:50:131
88749965,1cyclictest244-20systemd-journal12:35:401
88749964,2cyclictest743-21snmpd12:17:391
88749964,2cyclictest743-21snmpd12:12:141
88749964,2cyclictest743-21snmpd11:14:511
88749964,2cyclictest743-21snmpd10:41:141
88749964,2cyclictest743-21snmpd10:02:031
88669966,0cyclictest743-21snmpd08:23:380
88669966,0cyclictest743-21snmpd08:03:200
88669966,0cyclictest741-21lldpd12:39:530
88669966,0cyclictest741-21lldpd11:36:380
88669966,0cyclictest741-21lldpd11:01:560
88669966,0cyclictest741-21lldpd09:13:220
88669966,0cyclictest741-21lldpd08:52:100
88669966,0cyclictest244-20systemd-journal07:41:400
88669965,1cyclictest743-21snmpd11:40:250
88669965,1cyclictest743-21snmpd11:17:450
88669965,1cyclictest743-21snmpd10:50:590
88669964,2cyclictest743-21snmpd10:30:280
88669964,2cyclictest743-21snmpd08:59:250
88669963,3cyclictest743-21snmpd07:23:150
88669963,2cyclictest575-21rs:main0
88669962,3cyclictest244-20systemd-journal08:28:100
88669962,3cyclictest15113-21awk08:45:110
88749955,0cyclictest743-21snmpd09:46:391
88749954,1cyclictest9903-21ntpq08:30:161
88749954,1cyclictest741-21lldpd09:56:311
88749954,1cyclictest29619-21gltestperf08:00:131
88749953,2cyclictest743-21snmpd11:56:071
88749953,2cyclictest31277-21cat12:00:151
88749952,3cyclictest557-21NetworkManager07:15:191
88749952,2cyclictest26433-21cut10:30:131
88749951,3cyclictest748-21netstat10:45:161
88669955,0cyclictest741-21lldpd12:31:430
88669955,0cyclictest741-21lldpd10:48:030
88669955,0cyclictest522-21avahi-daemon08:43:210
88669954,1cyclictest573-21in:imuxsock08:11:040
88669954,1cyclictest522-21avahi-daemon10:03:340
88669954,1cyclictest4565-21cpuspeed_turbos12:15:120
88669954,1cyclictest3358-21nvmesmart_nvme012:10:180
88669953,2cyclictest743-21snmpd09:23:500
88669952,3cyclictest7768-21ld12:20:160
88669952,2cyclictest28211-21cut10:35:130
88669952,2cyclictest244-20systemd-journal10:22:360
88669952,2cyclictest1033-21grep09:25:200
88669951,4cyclictest557-21NetworkManager07:16:340
88669951,3cyclictest244-20systemd-journal11:27:390
88669950,4cyclictest28109-21ntpq07:55:170
88749942,2cyclictest743-21snmpd09:50:031
88749942,2cyclictest743-21snmpd08:25:091
88749942,2cyclictest15946-21cat10:05:111
88749942,2cyclictest12853-21cat12:30:151
88749941,2cyclictest5989-21expr09:40:121
88749941,2cyclictest31567-21sort08:05:141
88749941,2cyclictest21178-21cpu09:00:111
88669942,2cyclictest8637-21cat11:05:150
88669941,2cyclictest29063-21tune2fs11:55:130
88669940,3cyclictest4394-21grep10:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional