You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 20:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sun Sep 20, 2026 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277969910531049,3cyclictest21954-21kworker/3:0+events10:04:213
277799910531049,3cyclictest20877-21turbostat09:59:540
277969910521050,2cyclictest21954-21kworker/3:0+events10:28:173
277969910521050,2cyclictest20018-21kworker/3:2+events11:47:123
277969910521050,2cyclictest1688-21kworker/3:1+events09:20:223
277969910521049,3cyclictest8889-21kworker/3:3+events10:31:073
277969910521048,3cyclictest21954-21kworker/3:0+events09:26:513
277969910511049,2cyclictest21954-21kworker/3:0+events11:18:363
277969910511048,3cyclictest29923-21kworker/3:2+events10:15:223
277969910511048,3cyclictest12149-21kworker/3:1+events09:51:043
277969910511047,3cyclictest20018-21kworker/3:2+events11:58:353
277939910511049,2cyclictest21486-21kworker/2:2+events09:58:402
277799910511047,3cyclictest21341-21kworker/0:1+events10:41:050
277969910501048,2cyclictest21954-21kworker/3:0+events10:08:463
277969910501048,2cyclictest12149-21kworker/3:1+events09:46:143
277969910501048,2cyclictest11314-21kworker/3:1+events11:35:443
277969910501047,3cyclictest8889-21kworker/3:3+events10:23:163
277969910501047,3cyclictest29923-21kworker/3:2+events10:12:133
277969910501046,3cyclictest20018-21kworker/3:2+events11:50:223
277799910491047,2cyclictest21341-21kworker/0:1+events11:01:590
277799910481047,1cyclictest2314-21kworker/0:0+events10:48:560
277939910471046,1cyclictest26031-21kworker/2:1+events07:34:522
277799910471045,2cyclictest9055-21kworker/0:0+events09:12:140
277799910441042,2cyclictest19900-21kworker/0:0+events11:07:580
277799910441042,2cyclictest18791-21kworker/0:1+events08:30:220
277799910441041,2cyclictest12173-21kworker/0:2+events08:18:210
277939910431042,1cyclictest21486-21kworker/2:2+events10:50:532
277799910431041,2cyclictest9055-21kworker/0:0+events08:59:020
277799910431041,2cyclictest24616-21kworker/0:1+events11:44:370
277799910431041,2cyclictest18791-21kworker/0:1+events08:41:060
277799910421040,2cyclictest21341-21kworker/0:1+events09:42:540
277799910421040,2cyclictest18791-21kworker/0:1+events08:54:030
277799910421040,2cyclictest18791-21kworker/0:1+events08:54:030
277799910421039,3cyclictest18791-21kworker/0:1+events08:23:180
277799910421037,4cyclictest9055-21kworker/0:0+events09:06:070
277799910401037,3cyclictest18791-21kworker/0:1+events08:27:100
277799910391037,2cyclictest9012-21kworker/0:2+events10:57:570
277799910391037,2cyclictest21341-21kworker/0:1+events09:37:000
277799910381035,3cyclictest31507-21kworker/0:2+events09:32:580
277799910371035,2cyclictest31472-21kworker/0:0+events11:20:440
277799910361034,2cyclictest12173-21kworker/0:2+events08:11:170
277799910351032,3cyclictest12173-21kworker/0:2+events08:06:060
277869910341033,1cyclictest10344-21kworker/1:2+events12:01:081
277799910331031,2cyclictest9012-21kworker/0:2+events11:11:070
277799910321030,2cyclictest18791-21kworker/0:1+events09:01:060
277799910321029,3cyclictest26922-21kworker/0:0+events08:39:040
277939910311029,2cyclictest25189-21turbostat10:04:552
277799910311028,3cyclictest9055-21kworker/0:0+events09:16:480
277799910311027,3cyclictest26922-21kworker/0:0+events08:45:200
277869910291026,3cyclictest15710-21turbostat11:44:561
277869910271026,1cyclictest29610-21turbostat10:09:541
277869910201018,2cyclictest19762-21turbostat10:34:551
277869910181016,2cyclictest1282-21kworker/1:0+events12:21:071
277869910171016,1cyclictest1282-21kworker/1:0+events12:14:531
277869910161013,3cyclictest24072-21turbostat10:39:551
277869910141013,1cyclictest10308-21kworker/1:0+events11:32:471
277869910111009,2cyclictest10308-21kworker/1:0+events11:26:511
277869910071003,2cyclictest30203-21kworker/1:2+events12:35:231
277869910051004,1cyclictest1282-21kworker/1:0+events12:06:401
277869910001000,0cyclictest20742-21kworker/1:2+events12:25:221
2778699998996,2cyclictest16046-21kworker/1:1+events12:19:031
2779399996995,1cyclictest26031-21kworker/2:1+events07:10:222
2779699991989,2cyclictest4739-21turbostat10:54:553
2778699991988,3cyclictest7830-21turbostat09:44:551
2778699990989,1cyclictest16046-21kworker/1:1+events12:33:281
2779399980979,1cyclictest26031-21kworker/2:1+events07:38:382
2779699977974,3cyclictest30776-21turbostat11:24:553
2779399969968,1cyclictest26031-21kworker/2:1+events07:59:472
2779399966964,2cyclictest31402-21kworker/2:2+events07:20:452
2778699958956,2cyclictest14989-21turbostat10:29:541
2778699953951,2cyclictest26447-21turbostat11:19:541
2778699946944,2cyclictest22135-21turbostat11:14:551
2777999941938,3cyclictest28765-21turbostat11:59:550
2779699940938,2cyclictest29064-21turbostat08:34:563
2778699925922,3cyclictest351-21turbostat10:49:541
2778699916913,3cyclictest17664-21turbostat09:19:551
2779699913911,2cyclictest20538-21turbostat08:14:563
2779699913910,3cyclictest16502-21turbostat08:04:553
2779399903902,1cyclictest9441-21kworker/2:2+events07:45:202
2779399902901,1cyclictest26031-21kworker/2:1+events07:15:222
2779399898897,1cyclictest7363-21kworker/2:0+events07:42:562
2779399891890,1cyclictest9441-21kworker/2:2+events07:51:302
2778699891889,2cyclictest20079-21turbostat11:49:561
2779399882881,1cyclictest26031-21kworker/2:1+events07:28:362
2779399882880,2cyclictest7069-21turbostat11:34:542
2779399881880,1cyclictest26031-21kworker/2:1+events08:04:422
2777999864862,2cyclictest16543-21turbostat09:54:540
2779399863861,2cyclictest9075-21turbostat10:59:542
2779399679678,1cyclictest16543-21turbostat09:54:542
2778699671668,3cyclictest30776-21turbostat11:24:541
2778699659655,4cyclictest28765-21turbostat11:59:551
2777999645642,3cyclictest16502-21turbostat08:04:560
2779699643641,2cyclictest15710-21turbostat11:44:563
2779699629626,3cyclictest20877-21turbostat09:59:553
2777999611607,3cyclictest24072-21turbostat10:39:550
2779699607604,3cyclictest7830-21turbostat09:44:553
2779699600597,3cyclictest7069-21turbostat11:34:543
2779399577576,1cyclictest351-21turbostat10:49:552
2779699563560,3cyclictest22135-21turbostat11:14:553
2777999545544,1cyclictest26447-21turbostat11:19:550
2779699534533,1cyclictest31528-21turbostat12:39:563
2779699531528,3cyclictest17664-21turbostat09:19:553
2777999521521,0cyclictest4739-21turbostat10:54:550
2777999499496,3cyclictest26839-21turbostat09:29:560
2777999497495,2cyclictest11383-21turbostat11:39:550
27786991919,0cyclictest67750irq/123-lan11:05:171
27786991918,1cyclictest67750irq/123-lan10:10:131
27786991817,1cyclictest67750irq/123-lan11:52:141
27786991817,1cyclictest67750irq/123-lan10:00:131
27786991817,1cyclictest67750irq/123-lan09:45:181
27786991817,1cyclictest67750irq/123-lan09:30:131
27786991817,1cyclictest67750irq/123-lan09:10:141
27786991817,1cyclictest67750irq/123-lan08:49:381
27786991717,0cyclictest784-21snmpd11:39:271
27786991717,0cyclictest784-21snmpd10:58:021
27786991717,0cyclictest784-21snmpd07:17:301
27786991717,0cyclictest67750irq/123-lan11:03:171
27786991717,0cyclictest67750irq/123-lan10:43:361
27786991717,0cyclictest67750irq/123-lan09:37:001
27786991717,0cyclictest67750irq/123-lan09:25:041
27786991716,1cyclictest67750irq/123-lan09:55:211
27786991716,1cyclictest67750irq/123-lan09:50:141
27786991716,1cyclictest67750irq/123-lan09:23:051
27786991716,1cyclictest67750irq/123-lan09:08:171
27786991716,1cyclictest67750irq/123-lan08:50:191
27786991716,1cyclictest67750irq/123-lan08:50:191
27786991716,1cyclictest67750irq/123-lan08:30:351
27786991716,1cyclictest67750irq/123-lan07:50:481
27786991716,1cyclictest67750irq/123-lan07:45:141
27786991716,1cyclictest67750irq/123-lan07:26:581
27786991616,0cyclictest784-21snmpd08:16:061
27786991616,0cyclictest67750irq/123-lan10:51:001
27786991616,0cyclictest67750irq/123-lan08:39:101
27786991615,1cyclictest67750irq/123-lan10:18:401
27786991515,0cyclictest784-21snmpd10:20:181
27786991515,0cyclictest67750irq/123-lan08:55:201
27786991515,0cyclictest67750irq/123-lan08:43:361
27786991515,0cyclictest67750irq/123-lan08:20:141
27786991515,0cyclictest67750irq/123-lan08:05:131
27786991515,0cyclictest67750irq/123-lan08:00:181
27786991515,0cyclictest67750irq/123-lan07:55:151
27786991515,0cyclictest67750irq/123-lan07:11:021
27786991514,1cyclictest67750irq/123-lan07:40:121
27786991514,1cyclictest67750irq/123-lan07:30:151
27786991514,1cyclictest67750irq/123-lan07:20:131
27786991413,1cyclictest67750irq/123-lan08:25:141
27786991413,1cyclictest67750irq/123-lan08:13:011
27786991313,0cyclictest67750irq/123-lan09:00:161
27786991111,0cyclictest67750irq/123-lan07:35:171
277939998,1cyclictest784-21snmpd08:53:402
277939998,1cyclictest784-21snmpd08:53:392
277799998,1cyclictest507-21systemd-resolve10:09:500
277969988,0cyclictest784-21snmpd12:34:243
277969988,0cyclictest784-21snmpd12:16:053
277969988,0cyclictest784-21snmpd12:01:523
277969988,0cyclictest784-21snmpd11:26:423
277969988,0cyclictest784-21snmpd11:01:283
277969988,0cyclictest784-21snmpd10:39:053
277969988,0cyclictest782-21lldpd08:56:593
277969988,0cyclictest782-21lldpd08:53:403
277969988,0cyclictest782-21lldpd08:53:393
277969988,0cyclictest782-21lldpd07:52:423
277969987,1cyclictest15361-21needreboot07:55:173
277969987,1cyclictest11566-21cpuspeed_turbos09:05:133
277969986,2cyclictest784-21snmpd07:44:583
277939988,0cyclictest784-21snmpd12:25:342
277939988,0cyclictest784-21snmpd12:13:492
277939988,0cyclictest782-21lldpd12:32:172
277939988,0cyclictest782-21lldpd11:06:462
277939988,0cyclictest782-21lldpd10:10:382
277939988,0cyclictest782-21lldpd08:25:012
277939987,1cyclictest784-21snmpd11:55:252
277939987,1cyclictest784-21snmpd11:18:352
277939987,1cyclictest784-21snmpd08:56:272
277939987,1cyclictest782-21lldpd08:49:332
277939987,1cyclictest572-21in:imuxsock10:23:312
277939987,1cyclictest526-21avahi-daemon11:23:152
277939987,1cyclictest526-21avahi-daemon10:05:252
277799988,0cyclictest784-21snmpd11:34:060
277799988,0cyclictest784-21snmpd10:26:000
277799988,0cyclictest782-21lldpd12:23:390
277799988,0cyclictest782-21lldpd12:19:450
277799988,0cyclictest782-21lldpd07:59:230
277799987,1cyclictest784-21snmpd10:24:190
277799987,1cyclictest507-21systemd-resolve12:02:560
277799986,2cyclictest784-21snmpd12:12:580
277969977,0cyclictest784-21snmpd11:06:333
277969977,0cyclictest784-21snmpd08:44:453
277969977,0cyclictest784-21snmpd08:37:163
277969977,0cyclictest782-21lldpd09:32:003
277969977,0cyclictest782-21lldpd07:12:483
277969976,1cyclictest782-21lldpd10:45:483
277969976,1cyclictest32693-21needreboot07:20:163
277969975,2cyclictest784-21snmpd09:12:223
277969973,3cyclictest245-20systemd-journal08:20:163
277939977,0cyclictest784-21snmpd10:25:392
277939977,0cyclictest784-21snmpd09:14:372
277939977,0cyclictest784-21snmpd09:01:132
277939977,0cyclictest782-21lldpd11:42:022
277939977,0cyclictest782-21lldpd10:18:352
277939977,0cyclictest782-21lldpd08:21:452
277939976,1cyclictest784-21snmpd09:23:352
277939976,1cyclictest784-21snmpd09:17:042
277939976,1cyclictest782-21lldpd11:25:222
277939976,1cyclictest507-21systemd-resolve11:47:062
277939976,1cyclictest507-21systemd-resolve09:48:152
277939975,2cyclictest784-21snmpd10:31:492
277939975,2cyclictest784-21snmpd09:39:572
277939975,2cyclictest784-21snmpd09:28:082
277939975,2cyclictest784-21snmpd09:09:412
277799977,0cyclictest784-21snmpd10:12:150
277799977,0cyclictest784-21snmpd07:17:390
277799977,0cyclictest782-21lldpd12:09:030
277799977,0cyclictest782-21lldpd11:48:490
277799976,1cyclictest784-21snmpd10:01:030
277799975,2cyclictest784-21snmpd12:32:580
277969966,0cyclictest784-21snmpd08:18:183
277969966,0cyclictest784-21snmpd08:09:563
277969965,1cyclictest784-21snmpd10:57:403
277969965,1cyclictest526-21avahi-daemon12:20:223
277969965,1cyclictest526-21avahi-daemon07:26:333
277969964,2cyclictest784-21snmpd12:05:283
277969963,3cyclictest7035-21ssh09:38:343
277969962,3cyclictest28605-21awk08:25:213
277969962,3cyclictest245-20systemd-journal12:11:213
277939966,0cyclictest782-21lldpd10:40:472
277939966,0cyclictest782-21lldpd10:36:222
277939966,0cyclictest782-21lldpd08:36:062
277939964,2cyclictest784-21snmpd08:06:472
277939963,3cyclictest547-21NetworkManager12:03:162
277939963,3cyclictest547-21NetworkManager11:35:002
277939963,3cyclictest25373-21memory11:50:162
277939963,2cyclictest615-21ssh09:30:302
277939963,2cyclictest245-20systemd-journal11:02:382
277799966,0cyclictest784-21snmpd07:50:100
277799966,0cyclictest782-21lldpd09:45:210
277799965,1cyclictest784-21snmpd07:14:000
277799965,1cyclictest526-21avahi-daemon07:31:270
277799965,1cyclictest22909-21cpuspeed_turbos09:20:110
277799964,2cyclictest784-21snmpd07:29:170
277799964,2cyclictest26727-21sshd11:51:190
277799963,3cyclictest547-21NetworkManager12:28:300
277799962,2cyclictest7222-21mandb07:35:570
277969955,0cyclictest6061-21head07:35:163
277969954,1cyclictest511ktimers/310:40:133
277969953,2cyclictest11658-21sed07:50:003
277969952,2cyclictest5421-21sshd07:34:183
277969952,2cyclictest23340-21wc12:25:153
277969952,2cyclictest10266-21ld09:00:183
277969951,3cyclictest3386-21smartctl08:45:143
277939953,2cyclictest19450-21tr12:20:182
277939953,2cyclictest1425-21cat08:40:152
277939952,2cyclictest6304-21ld12:05:172
277939952,2cyclictest574-21rs:main2
277939952,2cyclictest2701-21ssh12:38:372
277939952,2cyclictest22553-21apt-get08:15:012
277939952,2cyclictest16245-21ssh12:16:402
277939952,2cyclictest10029-21ssh09:41:002
277799955,0cyclictest784-21snmpd12:36:480
277799954,1cyclictest7921-21cpuspeed_turbos07:40:120
277799954,1cyclictest507-21systemd-resolve07:24:110
277799952,3cyclictest10960-21cat07:45:200
277799952,2cyclictest245-20systemd-journal10:17:320
277799952,2cyclictest22169-21ssh10:31:300
277969940,4cyclictest30838-21ntpq07:15:173
277939944,0cyclictest784-21snmpd08:10:262
277939940,3cyclictest30165-21ntpq08:30:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional