You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 09:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Fri Sep 11, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316309910531049,3cyclictest27008-21kworker/3:1+events23:29:203
316309910531049,3cyclictest27008-21kworker/3:1+events23:29:203
316309910521050,2cyclictest3476-21kworker/3:0+events22:30:413
316309910521050,2cyclictest31808-21kworker/3:0+events00:19:303
316309910521050,2cyclictest22459-21kworker/3:0+events20:12:383
316309910521050,2cyclictest22459-21kworker/3:0+events20:07:093
316309910521050,2cyclictest20894-21kworker/3:2+events00:20:443
316309910521050,2cyclictest12269-21kworker/3:2+events23:17:333
316309910521050,2cyclictest11198-21kworker/3:2+events23:56:063
316309910521049,3cyclictest24522-21kworker/3:2+events20:51:053
316309910521047,4cyclictest11198-21kworker/3:2+events23:48:153
316309910511049,2cyclictest3476-21kworker/3:0+events23:20:443
316309910511049,2cyclictest3476-21kworker/3:0+events22:38:373
316309910511049,2cyclictest27008-21kworker/3:1+events23:42:323
316309910511049,2cyclictest17902-21kworker/3:2+events19:55:323
316309910511049,2cyclictest12269-21kworker/3:2+events23:10:433
316309910511048,3cyclictest27008-21kworker/3:1+events23:31:073
316309910511046,4cyclictest13377-21kworker/3:0+events19:54:313
316309910501048,2cyclictest7631-21kworker/3:2+events19:30:413
316309910501048,2cyclictest1559-21kworker/3:1+events19:15:313
316309910501047,3cyclictest11198-21kworker/3:2+events00:00:223
316309910491047,2cyclictest3508-21kworker/3:0+events00:36:063
316309910491047,2cyclictest27008-21kworker/3:1+events23:51:263
316309910491046,2cyclictest19960-21kworker/3:1+events20:04:523
316309910491046,2cyclictest13377-21kworker/3:0+events19:48:453
316309910491045,2cyclictest13377-21kworker/3:0+events19:41:303
316309910481045,3cyclictest7631-21kworker/3:2+events19:35:423
316229910481047,1cyclictest24506-21kworker/1:2+events19:13:591
316229910451044,1cyclictest7784-21kworker/1:1+events21:37:571
316189910361035,1cyclictest16320-21kworker/0:0+events21:53:210
316309910321027,3cyclictest10798-21turbostat21:39:553
316229910311029,2cyclictest25623-21kworker/1:0+events21:29:471
316229910271025,2cyclictest1395-21kworker/1:0+events22:29:121
316279910241023,1cyclictest13779-21kworker/2:2+events22:44:092
316229910241023,1cyclictest25623-21kworker/1:0+events21:19:051
316229910241022,2cyclictest3854-21kworker/1:1+events19:26:581
316189910231021,2cyclictest23721-21turbostat22:54:550
316229910211019,2cyclictest11539-21kworker/1:2+events21:23:511
316189910191016,3cyclictest7200-21turbostat23:09:550
316189910191016,3cyclictest20529-21turbostat00:24:550
316279910181017,1cyclictest20568-21kworker/2:0+events22:45:552
316189910121011,1cyclictest8702-21kworker/0:1+events21:48:380
316189910051004,1cyclictest8702-21kworker/0:1+events21:41:510
316189910051004,1cyclictest2097-21kworker/0:2+events20:41:280
316189910051003,1cyclictest1612-21kworker/0:2+events00:05:220
316189910011000,1cyclictest16320-21kworker/0:0+events21:55:410
3161899999996,3cyclictest6136-21turbostat23:39:550
3162299998997,1cyclictest26036-21kworker/1:0+events00:31:051
3161899998997,1cyclictest29341-21kworker/0:2+events20:25:220
3162799997994,3cyclictest972-21turbostat23:34:552
3161899994993,1cyclictest32441-21kworker/0:0+events20:31:270
3161899993992,1cyclictest26912-21kworker/0:1+events20:16:290
3161899993991,1cyclictest27721-21turbostat21:24:550
3162799991990,1cyclictest13779-21kworker/2:2+events00:11:482
3161899991990,1cyclictest2097-21kworker/0:2+events20:48:170
3162299989988,1cyclictest32576-21kworker/1:1+events00:25:221
3161899989988,1cyclictest26912-21kworker/0:1+events20:39:250
3162799988987,1cyclictest13779-21kworker/2:2+events22:50:432
3162299987984,3cyclictest1584-21turbostat19:19:551
3161899987986,1cyclictest1530-21kworker/0:1+events23:01:500
3162799986984,2cyclictest6439-21turbostat20:49:552
3161899986985,1cyclictest26912-21kworker/0:1+events20:22:340
3162799985983,2cyclictest28225-21turbostat23:29:552
3162799985983,2cyclictest28225-21turbostat23:29:552
3161899985984,1cyclictest22645-21turbostat20:09:550
3161899984982,2cyclictest8866-21turbostat20:54:540
3162299980980,0cyclictest4555-21kworker/1:1+events22:03:401
3162299980979,1cyclictest11365-21kworker/1:0+events22:07:371
3162299979978,1cyclictest7784-21kworker/1:1+events21:33:211
3162299977976,1cyclictest29196-21kworker/1:1+events22:56:121
3161899977974,3cyclictest31503-21turbostat19:14:550
3163099976974,2cyclictest5078-21turbostat00:09:553
3162299973969,2cyclictest11365-21kworker/1:0+events22:18:051
3163099972970,2cyclictest31423-21turbostat21:59:553
3162299971971,0cyclictest11539-21kworker/1:2+events21:12:121
3162299971969,1cyclictest5422-21kworker/1:2+events23:38:421
3162299970970,0cyclictest3854-21kworker/1:1+events20:55:211
3162299970969,1cyclictest31414-21kworker/1:0+events19:23:041
3162299967967,0cyclictest22782-21kworker/1:2+events22:24:271
3162299967966,1cyclictest17275-21kworker/1:1+events22:11:381
3162299966965,1cyclictest11539-21kworker/1:2+events21:08:151
3162299962961,1cyclictest11539-21kworker/1:2+events21:00:211
3162799926924,2cyclictest30371-21turbostat22:29:552
3163099925922,3cyclictest28856-21turbostat22:59:553
3162299902898,4cyclictest32299-21turbostat00:04:551
3161899677675,1cyclictest32299-21turbostat00:04:550
3162799657655,2cyclictest5078-21turbostat00:09:542
3163099645644,1cyclictest7200-21turbostat23:09:553
3162299633630,3cyclictest31423-21turbostat21:59:551
3163099624623,1cyclictest6136-21turbostat23:39:553
3163099615612,3cyclictest6439-21turbostat20:49:553
3161899606604,2cyclictest28856-21turbostat22:59:550
3163099603602,1cyclictest31503-21turbostat19:14:543
3162799600596,4cyclictest8288-21turbostat22:39:552
3161899595592,3cyclictest24660-21turbostat20:14:550
3163099576573,3cyclictest30821-21turbostat00:34:553
3162299557553,4cyclictest23721-21turbostat22:54:551
3163099555552,3cyclictest30371-21turbostat22:29:553
3162299549548,1cyclictest20529-21turbostat00:24:551
3162299529528,1cyclictest972-21turbostat23:34:551
3162299519515,4cyclictest8866-21turbostat20:54:541
3163099514512,2cyclictest10224-21turbostat00:14:543
3163099514511,3cyclictest5645-21turbostat19:29:553
3161899509507,2cyclictest10798-21turbostat21:39:550
31622991918,1cyclictest67750irq/123-lan23:10:121
31622991918,1cyclictest67750irq/123-lan23:00:151
31622991918,1cyclictest67750irq/123-lan21:50:191
31622991918,1cyclictest67750irq/123-lan21:45:191
31622991918,1cyclictest67750irq/123-lan21:40:181
31622991818,0cyclictest67750irq/123-lan23:47:171
31622991818,0cyclictest67750irq/123-lan23:15:131
31622991818,0cyclictest67750irq/123-lan22:38:281
31622991817,1cyclictest67750irq/123-lan23:55:591
31622991817,1cyclictest67750irq/123-lan23:44:171
31622991817,1cyclictest67750irq/123-lan23:27:291
31622991817,1cyclictest67750irq/123-lan23:27:291
31622991817,1cyclictest67750irq/123-lan00:05:121
31622991717,0cyclictest67750irq/123-lan23:20:151
31622991717,0cyclictest67750irq/123-lan20:15:171
31622991716,1cyclictest67750irq/123-lan23:05:181
31622991716,1cyclictest67750irq/123-lan00:38:061
31622991716,1cyclictest67750irq/123-lan00:19:311
31622991616,0cyclictest67750irq/123-lan23:53:171
31622991616,0cyclictest67750irq/123-lan19:50:191
31622991615,1cyclictest67750irq/123-lan22:45:131
31622991615,1cyclictest67750irq/123-lan22:31:141
31622991615,1cyclictest67750irq/123-lan20:30:191
31622991615,1cyclictest67750irq/123-lan19:40:211
31622991515,0cyclictest67750irq/123-lan22:40:141
31622991515,0cyclictest67750irq/123-lan20:45:201
31622991515,0cyclictest67750irq/123-lan20:25:151
31622991515,0cyclictest67750irq/123-lan20:05:211
31622991514,1cyclictest67750irq/123-lan19:30:121
31622991414,0cyclictest67750irq/123-lan19:45:191
31622991413,1cyclictest67750irq/123-lan20:10:111
31622991413,1cyclictest67750irq/123-lan19:55:151
31622991312,1cyclictest67750irq/123-lan20:40:111
31622991312,1cyclictest67750irq/123-lan00:11:241
31622991212,0cyclictest67750irq/123-lan20:35:151
31622991211,1cyclictest67750irq/123-lan20:00:151
31622991211,1cyclictest67750irq/123-lan19:35:121
3162299109,1cyclictest67750irq/123-lan20:20:191
3161899109,1cyclictest8702-21kworker/0:1+events21:26:310
316279998,1cyclictest526-21avahi-daemon20:44:032
316279998,1cyclictest507-21systemd-resolve21:34:442
316189998,1cyclictest784-21snmpd23:13:390
316309988,0cyclictest784-21snmpd21:04:103
316309988,0cyclictest782-21lldpd21:07:023
316309988,0cyclictest782-21lldpd20:41:203
316309987,1cyclictest784-21snmpd21:10:223
316309987,1cyclictest782-21lldpd21:28:213
316309987,1cyclictest782-21lldpd00:28:273
316309986,2cyclictest784-21snmpd22:10:243
316309986,2cyclictest784-21snmpd22:09:513
316309986,2cyclictest784-21snmpd20:27:183
316279988,0cyclictest784-21snmpd19:23:282
316279988,0cyclictest782-21lldpd23:09:142
316279988,0cyclictest782-21lldpd22:24:162
316279988,0cyclictest782-21lldpd20:54:182
316279988,0cyclictest782-21lldpd00:21:352
316279987,1cyclictest784-21snmpd00:26:022
316279987,1cyclictest782-21lldpd23:46:432
316279987,1cyclictest526-21avahi-daemon21:11:162
316279987,1cyclictest31906-21needreboot00:30:152
316279986,2cyclictest784-21snmpd23:37:302
316279986,2cyclictest784-21snmpd00:35:302
316279986,2cyclictest762-21ntpd23:51:212
316279986,2cyclictest762-21ntpd23:42:392
316279986,2cyclictest762-21ntpd23:17:212
316279986,2cyclictest762-21ntpd23:13:572
316279986,2cyclictest762-21ntpd21:51:342
316279986,2cyclictest762-21ntpd21:40:052
316279986,2cyclictest762-21ntpd21:26:282
316279986,2cyclictest762-21ntpd00:01:182
316189988,0cyclictest784-21snmpd22:48:440
316189988,0cyclictest784-21snmpd21:02:520
316189988,0cyclictest784-21snmpd19:31:400
316189988,0cyclictest782-21lldpd22:38:540
316189988,0cyclictest782-21lldpd19:39:060
316189988,0cyclictest782-21lldpd19:24:480
316189988,0cyclictest782-21lldpd19:16:150
316189986,2cyclictest784-21snmpd19:47:160
316189986,2cyclictest762-21ntpd22:24:500
316309977,0cyclictest784-21snmpd21:44:393
316309977,0cyclictest784-21snmpd21:22:143
316309977,0cyclictest782-21lldpd21:34:173
316309977,0cyclictest782-21lldpd20:58:363
316309976,1cyclictest784-21snmpd23:02:443
316309976,1cyclictest507-21systemd-resolve22:22:433
316309975,2cyclictest784-21snmpd21:55:003
316309975,2cyclictest784-21snmpd20:15:023
316279977,0cyclictest784-21snmpd23:20:422
316279977,0cyclictest784-21snmpd19:12:472
316279977,0cyclictest782-21lldpd23:01:342
316279977,0cyclictest782-21lldpd21:37:332
316279977,0cyclictest782-21lldpd21:01:402
316279977,0cyclictest782-21lldpd19:26:122
316279977,0cyclictest526-21avahi-daemon20:20:472
316279976,1cyclictest784-21snmpd19:49:462
316279976,1cyclictest784-21snmpd19:44:042
316279976,1cyclictest762-21ntpd22:17:542
316279976,1cyclictest762-21ntpd21:57:242
316279976,1cyclictest762-21ntpd21:20:192
316279976,1cyclictest762-21ntpd00:15:442
316279976,1cyclictest4252-21ntpq22:30:152
316279976,1cyclictest27821-21nvmesmart_nvme020:15:192
316279975,2cyclictest784-21snmpd19:51:132
316279975,2cyclictest784-21snmpd19:31:062
316279975,2cyclictest762-21ntpd22:56:032
316279975,2cyclictest762-21ntpd22:06:082
316279974,2cyclictest547-21NetworkManager22:00:022
316279973,3cyclictest31853-21ntp_states20:25:172
316279973,3cyclictest23863-21ntp_states21:15:182
316189977,0cyclictest784-21snmpd22:10:210
316189977,0cyclictest784-21snmpd21:30:530
316189977,0cyclictest784-21snmpd20:03:320
316189977,0cyclictest784-21snmpd19:27:310
316189977,0cyclictest784-21snmpd00:10:200
316189977,0cyclictest782-21lldpd23:23:370
316189977,0cyclictest782-21lldpd22:31:140
316189977,0cyclictest782-21lldpd22:29:360
316189977,0cyclictest526-21avahi-daemon23:17:410
316189976,1cyclictest762-21ntpd23:56:120
316189975,2cyclictest784-21snmpd22:44:140
316189975,2cyclictest784-21snmpd21:19:080
316189975,2cyclictest762-21ntpd23:47:070
316189975,2cyclictest762-21ntpd00:16:400
316189974,3cyclictest4403-21ssh00:35:150
316309966,0cyclictest784-21snmpd21:48:573
316309966,0cyclictest782-21lldpd22:41:183
316309966,0cyclictest782-21lldpd20:22:163
316309965,1cyclictest0-21swapper/322:15:123
316309962,3cyclictest27000-21ssh22:52:233
316309962,3cyclictest26861-21ssh21:18:483
316279965,1cyclictest784-21snmpd20:13:522
316279964,2cyclictest784-21snmpd19:35:072
316279964,2cyclictest762-21ntpd21:47:542
316279963,2cyclictest3312-21netstat20:35:152
316279963,2cyclictest20698-21apt-config20:00:002
316189966,0cyclictest784-21snmpd23:28:510
316189966,0cyclictest784-21snmpd23:28:510
316189966,0cyclictest784-21snmpd20:59:160
316189966,0cyclictest784-21snmpd19:57:560
316189966,0cyclictest30816-21sh00:30:000
316189965,1cyclictest782-21lldpd19:44:280
316189965,1cyclictest2235-21ntp_kernel_pll_23:30:200
316189964,2cyclictest784-21snmpd21:08:220
316189962,3cyclictest869-21ssh00:31:100
316189962,3cyclictest23030-21ssh22:16:560
316189962,3cyclictest18641-21ld21:10:160
316189962,3cyclictest10051-21fw_packets22:05:130
316309955,0cyclictest782-21lldpd22:45:303
316309953,2cyclictest576-21apt20:30:113
316309952,3cyclictest784-21snmpd20:36:183
316309952,2cyclictest6704-21ssh22:01:173
316309951,3cyclictest245-20systemd-journal19:22:153
316279955,0cyclictest18731-21rm22:13:082
316279953,2cyclictest762-21ntpd19:55:162
316279952,3cyclictest23172-21perl20:05:142
316279952,2cyclictest28368-21ntpq23:55:182
316279952,2cyclictest16884-21grep21:05:202
316279952,2cyclictest1299-21netstat20:30:142
316279952,2cyclictest10907-21https20:55:002
316279950,4cyclictest2666-21ntpq19:15:162
316189952,3cyclictest507-21systemd-resolve23:40:040
316189952,2cyclictest25531-21ssh23:52:460
316189951,3cyclictest8424-21ssh22:03:430
316189943,1cyclictest29341-21kworker/0:2+events19:50:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional