You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 18:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue May 12, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1245993838,0cyclictest11810-21fwupd08:51:372
1234992019,1cyclictest65850irq/126-lan10:35:161
1234991918,1cyclictest65850irq/126-lan11:15:171
1234991818,0cyclictest65850irq/126-lan08:41:521
1234991818,0cyclictest65850irq/126-lan07:40:151
1234991817,1cyclictest65850irq/126-lan11:22:371
1234991817,1cyclictest65850irq/126-lan08:50:211
1234991717,0cyclictest65850irq/126-lan11:34:501
1234991717,0cyclictest65850irq/126-lan10:55:131
1234991717,0cyclictest65850irq/126-lan10:27:211
1234991717,0cyclictest65850irq/126-lan08:15:161
1234991716,1cyclictest65850irq/126-lan12:35:131
1234991716,1cyclictest65850irq/126-lan12:10:131
1234991716,1cyclictest65850irq/126-lan11:55:001
1234991716,1cyclictest65850irq/126-lan11:00:221
1234991716,1cyclictest65850irq/126-lan10:10:141
1234991716,1cyclictest65850irq/126-lan09:55:121
1234991716,1cyclictest65850irq/126-lan09:50:151
1234991716,1cyclictest65850irq/126-lan09:35:181
1234991716,1cyclictest65850irq/126-lan08:45:131
1234991716,1cyclictest65850irq/126-lan08:37:001
1234991716,1cyclictest65850irq/126-lan08:30:111
1234991716,1cyclictest65850irq/126-lan07:55:121
1234991616,0cyclictest65850irq/126-lan12:05:231
1234991616,0cyclictest65850irq/126-lan08:10:151
1234991616,0cyclictest65850irq/126-lan07:50:181
1234991615,1cyclictest65850irq/126-lan12:30:111
1234991615,1cyclictest65850irq/126-lan12:25:141
1234991615,1cyclictest65850irq/126-lan10:50:181
1234991615,1cyclictest65850irq/126-lan09:20:131
1234991615,1cyclictest65850irq/126-lan08:25:181
1234991615,1cyclictest65850irq/126-lan08:05:161
1234991515,0cyclictest65850irq/126-lan11:45:151
1234991515,0cyclictest65850irq/126-lan11:10:111
1234991515,0cyclictest65850irq/126-lan10:00:141
1234991515,0cyclictest65850irq/126-lan09:25:201
1234991515,0cyclictest65850irq/126-lan09:15:371
1234991515,0cyclictest65850irq/126-lan08:00:161
1234991514,1cyclictest65850irq/126-lan12:15:151
1234991514,1cyclictest65850irq/126-lan12:00:171
1234991514,1cyclictest65850irq/126-lan10:40:141
1234991514,1cyclictest65850irq/126-lan09:40:121
1234991514,1cyclictest65850irq/126-lan08:20:131
1234991514,1cyclictest65850irq/126-lan07:34:361
1234991414,0cyclictest65850irq/126-lan09:30:181
1234991414,0cyclictest65850irq/126-lan09:05:361
1234991414,0cyclictest65850irq/126-lan07:35:161
1234991414,0cyclictest65850irq/126-lan07:10:121
1234991413,1cyclictest65850irq/126-lan11:25:171
1234991413,1cyclictest65850irq/126-lan09:45:131
1234991413,1cyclictest65850irq/126-lan07:25:151
1234991313,0cyclictest65850irq/126-lan11:55:321
1234991313,0cyclictest65850irq/126-lan10:30:141
1234991313,0cyclictest65850irq/126-lan10:20:181
1234991313,0cyclictest65850irq/126-lan07:46:351
1234991312,1cyclictest65850irq/126-lan11:40:121
1234991312,1cyclictest65850irq/126-lan07:20:171
1234991212,0cyclictest65850irq/126-lan09:10:121
1234991212,0cyclictest65850irq/126-lan07:15:161
1234991211,1cyclictest65850irq/126-lan12:20:201
1234991211,1cyclictest65850irq/126-lan11:35:161
1234991211,1cyclictest65850irq/126-lan10:45:151
1234991211,1cyclictest65850irq/126-lan10:15:221
1234991211,1cyclictest65850irq/126-lan09:00:141
124599116,3cyclictest575-21rs:main2
1234991111,0cyclictest65850irq/126-lan11:05:141
124599106,4cyclictest24913-21cat09:25:142
124599101,7cyclictest6362-21taskset11:16:052
124599100,6cyclictest20910-21ld07:55:162
1234991010,0cyclictest65850irq/126-lan10:05:181
12509998,1cyclictest743-21snmpd10:07:323
12509998,1cyclictest743-21snmpd07:44:243
12509998,1cyclictest741-21lldpd11:27:493
12509998,1cyclictest741-21lldpd10:32:013
12459997,2cyclictest743-21snmpd09:01:392
12459997,2cyclictest741-21lldpd11:48:162
12459997,2cyclictest522-21avahi-daemon10:51:122
12459996,3cyclictest743-21snmpd10:31:422
12459996,3cyclictest743-21snmpd09:23:062
12459996,3cyclictest0-21swapper/210:05:172
12459995,4cyclictest743-21snmpd09:42:042
12459993,5cyclictest743-21snmpd09:37:092
12459990,7cyclictest7617-21chrt07:24:472
12459990,7cyclictest4770-21wc08:35:142
12459990,6cyclictest7761-21chrt08:41:242
12459990,6cyclictest6829-21chrt12:37:482
12459990,6cyclictest515-21chrt11:04:222
12459990,6cyclictest5048-21ntpq09:55:182
12459990,6cyclictest31778-21taskset08:23:012
12459990,6cyclictest2893-21chrt11:10:062
12459990,6cyclictest26506-21taskset10:49:352
12459990,6cyclictest24716-21taskset12:03:162
12459990,6cyclictest14640-21chrt11:38:362
12459990,5cyclictest773-21sed09:45:152
12459990,5cyclictest7006-21ntpq10:00:182
12459990,5cyclictest29199-21awk12:15:122
12459990,5cyclictest1729-21dpkg07:10:012
12459990,5cyclictest17246-21ntpq09:05:162
12459990,5cyclictest12391-21chrt11:30:362
12459990,4cyclictest18938-21ld07:50:192
12299998,1cyclictest743-21snmpd10:57:310
12509988,0cyclictest743-21snmpd12:20:063
12509988,0cyclictest743-21snmpd11:45:503
12509988,0cyclictest743-21snmpd10:23:333
12509987,1cyclictest743-21snmpd12:08:333
12509987,1cyclictest743-21snmpd11:33:383
12509987,1cyclictest743-21snmpd09:34:313
12509987,1cyclictest522-21avahi-daemon11:22:223
12509987,1cyclictest23191-21cpuspeed_turbos12:00:133
12509986,2cyclictest743-21snmpd08:19:183
12509985,3cyclictest12696-21cat10:15:153
12459988,0cyclictest743-21snmpd11:05:042
12459988,0cyclictest741-21lldpd08:05:412
12459987,1cyclictest244-20systemd-journal10:10:502
12459986,2cyclictest741-21lldpd11:20:292
12459985,3cyclictest743-21snmpd07:36:362
12459985,3cyclictest741-21lldpd12:12:482
12459980,7cyclictest3658-21taskset09:51:462
12459980,7cyclictest27352-21wc08:10:212
12459980,7cyclictest22587-21chrt11:57:012
12459980,6cyclictest930-21grep08:25:212
12459980,6cyclictest21865-21chrt09:16:112
12459980,6cyclictest20017-21seq09:13:172
12459980,6cyclictest15982-21chrt10:24:192
12459980,6cyclictest0-21swapper/212:31:042
12459980,5cyclictest98632chrt08:47:332
12459980,5cyclictest9297-21chrt07:25:392
12459980,5cyclictest747-21runrttasks09:30:442
12459980,5cyclictest747-21runrttasks08:15:452
12459980,5cyclictest5252-21taskset07:15:442
12459980,5cyclictest3405-21chrt08:32:522
12459980,5cyclictest31524-21taskset12:20:132
12459980,5cyclictest2306-21seq12:26:532
12459980,5cyclictest22286-21df08:00:122
12459980,5cyclictest17498-21taskset07:46:062
12459980,5cyclictest13217-21proc_pri10:15:202
12459980,4cyclictest9777-21ld11:25:172
12459980,4cyclictest26221-21cat12:05:222
12459980,4cyclictest15328-21fschecks_time11:40:132
12459980,4cyclictest13197-21ld08:55:172
12459980,4cyclictest10708-21ntpq07:30:182
12459980,4cyclictest0-21swapper/211:50:202
12299988,0cyclictest743-21snmpd11:57:140
12299988,0cyclictest743-21snmpd09:14:000
12299988,0cyclictest741-21lldpd09:24:360
12299987,1cyclictest743-21snmpd09:54:440
12299987,1cyclictest741-21lldpd07:58:240
12299987,1cyclictest522-21avahi-daemon12:23:570
12299986,2cyclictest743-21snmpd12:32:310
12299986,2cyclictest743-21snmpd10:17:080
12299986,2cyclictest743-21snmpd07:53:120
12299986,2cyclictest743-21snmpd07:13:500
12509977,0cyclictest743-21snmpd09:38:063
12509977,0cyclictest743-21snmpd09:10:003
12509977,0cyclictest741-21lldpd10:28:393
12509977,0cyclictest741-21lldpd10:12:163
12509977,0cyclictest741-21lldpd10:02:363
12509977,0cyclictest741-21lldpd09:57:063
12509977,0cyclictest741-21lldpd08:43:273
12509977,0cyclictest741-21lldpd07:45:573
12509977,0cyclictest506-21systemd-resolve12:31:193
12509976,1cyclictest24569-21cat08:05:143
12509975,2cyclictest743-21snmpd11:58:053
12509975,2cyclictest743-21snmpd11:11:013
12509975,2cyclictest743-21snmpd07:33:173
12509975,2cyclictest743-21snmpd07:27:183
12509973,3cyclictest244-20systemd-journal07:50:233
12459970,6cyclictest16312-21apt-get10:25:112
12459970,5cyclictest30737-21chrt10:56:452
12459970,4cyclictest14805-21ntpq07:40:172
12459970,3cyclictest23517-21ntpq10:40:172
12349977,0cyclictest743-21snmpd08:59:361
12299977,0cyclictest743-21snmpd12:27:300
12299977,0cyclictest743-21snmpd11:54:230
12299977,0cyclictest743-21snmpd11:16:520
12299977,0cyclictest743-21snmpd09:36:520
12299977,0cyclictest743-21snmpd08:17:430
12299977,0cyclictest743-21snmpd07:32:540
12299977,0cyclictest741-21lldpd08:43:530
12299977,0cyclictest741-21lldpd08:26:570
12299977,0cyclictest522-21avahi-daemon07:19:340
12299976,1cyclictest743-21snmpd08:54:480
12299976,1cyclictest743-21snmpd07:41:330
12299976,1cyclictest522-21avahi-daemon12:15:010
12299976,1cyclictest522-21avahi-daemon09:45:010
12299976,1cyclictest522-21avahi-daemon08:05:370
12299976,1cyclictest25427-21needreboot10:45:150
12299975,2cyclictest743-21snmpd11:46:410
12299975,2cyclictest743-21snmpd11:40:320
12299975,2cyclictest743-21snmpd11:35:080
12299975,2cyclictest743-21snmpd11:01:190
12299975,2cyclictest743-21snmpd10:38:480
12299975,2cyclictest743-21snmpd08:21:530
12299975,2cyclictest743-21snmpd08:00:130
12509966,0cyclictest743-21snmpd08:36:443
12509966,0cyclictest741-21lldpd12:17:353
12509966,0cyclictest741-21lldpd09:40:183
12509966,0cyclictest741-21lldpd09:06:393
12509966,0cyclictest741-21lldpd08:10:453
12509966,0cyclictest741-21lldpd07:13:583
12509966,0cyclictest522-21avahi-daemon11:53:013
12509966,0cyclictest522-21avahi-daemon08:59:183
12509965,1cyclictest743-21snmpd11:42:533
12509965,1cyclictest743-21snmpd11:01:163
12509964,2cyclictest743-21snmpd10:56:023
12509964,2cyclictest743-21snmpd09:48:433
12509962,3cyclictest244-20systemd-journal08:51:373
12299966,0cyclictest743-21snmpd10:08:410
12299966,0cyclictest741-21lldpd12:14:200
12299966,0cyclictest741-21lldpd10:25:330
12299966,0cyclictest741-21lldpd09:06:150
12299966,0cyclictest741-21lldpd07:39:020
12299966,0cyclictest522-21avahi-daemon09:30:230
12299966,0cyclictest522-21avahi-daemon08:36:310
12299966,0cyclictest11382-21cut11:30:130
12299965,1cyclictest743-21snmpd10:31:390
12299965,1cyclictest743-21snmpd08:12:310
12299965,1cyclictest3104-21fschecks_count11:10:130
12299964,2cyclictest743-21snmpd12:37:050
12299964,2cyclictest743-21snmpd11:25:530
12299964,2cyclictest743-21snmpd11:21:550
12299962,4cyclictest557-21NetworkManager07:20:130
12299962,3cyclictest1076-21diskstats11:05:130
12509955,0cyclictest743-21snmpd12:10:123
12509955,0cyclictest743-21snmpd11:18:073
12509955,0cyclictest741-21lldpd10:40:453
12509955,0cyclictest741-21lldpd09:17:303
12509955,0cyclictest522-21avahi-daemon10:39:223
12509954,1cyclictest743-21snmpd11:06:403
12509954,1cyclictest743-21snmpd08:25:413
12509954,1cyclictest5340-21cpuspeed_turbos12:35:133
12509953,2cyclictest743-21snmpd12:29:063
12509953,2cyclictest743-21snmpd10:54:153
12509953,2cyclictest743-21snmpd08:45:053
12509953,2cyclictest743-21snmpd08:04:513
12509953,2cyclictest743-21snmpd07:22:183
12509953,2cyclictest743-21snmpd07:18:183
12509952,2cyclictest26253-21basename09:30:003
12509952,2cyclictest244-20systemd-journal11:35:033
12509952,2cyclictest20617-21wc07:55:143
12509951,3cyclictest3476-21awk09:50:203
12509951,3cyclictest30494-21fw_forwarded_lo08:20:113
12509951,3cyclictest24988-21grep10:45:123
12299955,0cyclictest573-21in:imuxsock10:21:300
12299955,0cyclictest522-21avahi-daemon10:44:560
12299954,1cyclictest573-21in:imuxsock10:50:280
12299954,1cyclictest2124-21fschecks_time08:30:110
12299953,2cyclictest14826-21cat09:00:150
12299952,3cyclictest743-21snmpd12:03:450
12299952,2cyclictest20721-21tune2fs09:15:130
12299952,2cyclictest16573-21grep07:45:160
12299952,2cyclictest13147-21ntpq08:55:170
12299951,3cyclictest4415-21grep09:55:120
12299950,4cyclictest7033-21ntpq10:00:190
12299950,3cyclictest26409-21cat09:30:000
12509940,4cyclictest741-21lldpd08:30:093
12509940,4cyclictest23282-21ntpq09:20:173
12509940,4cyclictest12680-21ntpq07:35:173
12509940,3cyclictest14578-21/usr/sbin/munin09:00:143
12299941,2cyclictest8669-21ld07:25:190
12299940,4cyclictest30855-21tail09:40:130
12299940,3cyclictest9133-21ntpq08:45:170
12299940,3cyclictest25296-21diskstats12:05:140
12299940,3cyclictest11015-21ntpq10:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional