You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 05:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Aug 26, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
271890,0ktimersoftd/212266-21perf18:45:382
304450770,0irq/25-eth10-21swapper/318:41:203
1879723423,0sleep00-21swapper/018:45:290
1855423430,0sleep10-21swapper/118:42:381
4160,0ktimersoftd/00-21swapper/022:12:580
339960,0migration/3762-21sh21:57:343
339960,0migration/34795-21sh21:01:033
339960,0migration/326782-21sh21:13:173
339960,0migration/323745-21sh23:14:493
339960,0migration/318071-21sh21:06:133
29715060,0irq/26-eth0-rx-8086-21aten2.4-expect23:25:593
29715060,0irq/26-eth0-rx-4020-21kthreadcore22:01:053
29715060,0irq/26-eth0-rx-26186-21cut19:36:053
27160,0ktimersoftd/211754-21diskmemload22:12:582
189019960,0cyclictest0-21swapper/221:20:232
149960,0migration/0514-21sh22:40:200
149960,0migration/023058-21sh23:12:450
149960,0migration/011646-21crond21:05:470
8215050,0irq/24-0000:00:30670-21kthreadcore19:41:052
8215050,0irq/24-0000:00:17896-21cat22:10:462
8215050,0irq/24-0000:00:0-21swapper/219:50:482
4150,0ktimersoftd/00-21swapper/022:56:070
35150,0ktimersoftd/30-21swapper/323:43:093
35150,0ktimersoftd/30-21swapper/321:16:103
339950,0migration/39465-21diskmemload21:42:543
339950,0migration/38022-21kthreadcore20:41:133
339950,0migration/36430-21kthreadcore20:16:083
339950,0migration/3584-21munin-node23:21:003
339950,0migration/332668-21kthreadcore00:01:043
339950,0migration/331658-21kthreadcore21:36:063
339950,0migration/330911-21kthreadcore19:16:053
339950,0migration/328020-21cpuspeed_turbos19:41:013
339950,0migration/32748-21irqrtprio22:21:023
339950,0migration/325864-21kthreadcore20:31:073
339950,0migration/325739-21latency_hist18:50:483
339950,0migration/317796-21switchtime20:46:113
339950,0migration/317632-21aten_r1power_cu20:25:593
339950,0migration/317379-21latency_hist22:30:463
339950,0migration/316514-21switchtime21:46:113
29725050,0irq/27-eth0-tx-987-21munin-node22:41:002
29725050,0irq/27-eth0-tx-8473-21munin-node23:06:072
29725050,0irq/27-eth0-tx-6258-21ssh23:43:242
29725050,0irq/27-eth0-tx-20071-21munin-node19:11:020
29725050,0irq/27-eth0-tx-1972-21forks22:20:592
29725050,0irq/27-eth0-tx-12315-21kthreadcore23:46:042
29725050,0irq/27-eth0-tx-11410-21perl21:46:022
29725050,0irq/27-eth0-tx-0-21swapper/221:15:072
29725050,0irq/27-eth0-tx-0-21swapper/220:55:272
29725050,0irq/27-eth0-tx-0-21swapper/019:46:350
29715050,0irq/26-eth0-rx-26151-21cut23:16:043
29715050,0irq/26-eth0-rx-20859-21tr23:31:053
29715050,0irq/26-eth0-rx-15879-21irqcore00:11:033
29715050,0irq/26-eth0-rx-155722sleep322:47:173
29715050,0irq/26-eth0-rx-13892-21expr19:06:023
29715050,0irq/26-eth0-rx-0-21swapper/323:46:313
29715050,0irq/26-eth0-rx-0-21swapper/323:39:293
29715050,0irq/26-eth0-rx-0-21swapper/323:06:233
29715050,0irq/26-eth0-rx-0-21swapper/322:58:083
29715050,0irq/26-eth0-rx-0-21swapper/322:36:363
29715050,0irq/26-eth0-rx-0-21swapper/322:26:013
29715050,0irq/26-eth0-rx-0-21swapper/322:16:023
29715050,0irq/26-eth0-rx-0-21swapper/322:11:533
29715050,0irq/26-eth0-rx-0-21swapper/321:54:423
29715050,0irq/26-eth0-rx-0-21swapper/321:31:303
29715050,0irq/26-eth0-rx-0-21swapper/321:31:303
29715050,0irq/26-eth0-rx-0-21swapper/321:21:173
29715050,0irq/26-eth0-rx-0-21swapper/320:55:413
29715050,0irq/26-eth0-rx-0-21swapper/319:46:023
259950,0migration/26755-21latency_hist00:05:462
259950,0migration/24238-21idleruntime21:21:022
259950,0migration/232248-21munin-node21:56:052
259950,0migration/224888-21sh22:34:552
259950,0migration/223401-21timerandwakeup20:26:182
259950,0migration/222151-21sh23:53:122
259950,0migration/218524-21taskset20:47:412
259950,0migration/217346-21kthreadcore00:11:042
259950,0migration/213479-21munin-node23:26:072
249950,0watchdog/231976-21cut00:01:012
249950,0watchdog/224494-21fschecks_time23:36:012
249950,0watchdog/212501-21kthreadcore20:21:062
19150,0ktimersoftd/10-21swapper/121:16:101
189019955,0cyclictest0-21swapper/223:31:142
189019955,0cyclictest0-21swapper/223:20:412
189019955,0cyclictest0-21swapper/222:15:532
189019955,0cyclictest0-21swapper/221:01:562
189019950,0cyclictest0-21swapper/223:59:182
189019950,0cyclictest0-21swapper/222:47:062
189019950,0cyclictest0-21swapper/221:10:372
189019950,0cyclictest0-21swapper/220:59:252
189009955,0cyclictest0-21swapper/122:56:091
189009950,0cyclictest0-21swapper/123:18:321
189009950,0cyclictest0-21swapper/122:11:411
189009950,0cyclictest0-21swapper/121:25:201
189009950,0cyclictest0-21swapper/121:11:091
189009950,0cyclictest0-21swapper/120:56:381
188999955,0cyclictest0-21swapper/023:17:250
188999955,0cyclictest0-21swapper/022:46:590
188999955,0cyclictest0-21swapper/022:32:470
188999955,0cyclictest0-21swapper/020:46:130
188999955,0cyclictest0-21swapper/020:00:490
188999955,0cyclictest0-21swapper/019:21:050
188999955,0cyclictest0-21swapper/000:04:140
188999950,0cyclictest0-21swapper/021:23:060
188999950,0cyclictest0-21swapper/021:15:510
179950,0migration/14241-21df_abs21:01:001
179950,0migration/14024-21kthreadcore22:01:051
179950,0migration/13740-21kthreadcore00:01:051
179950,0migration/132072-21cpuspeed_turbos23:41:001
179950,0migration/127238-21aten_r1power_en21:35:591
179950,0migration/113251-21kthreadcore21:06:041
179950,0migration/111119-21timerandwakeup20:41:191
179950,0migration/110564-21kthreadcore00:06:051
169950,0watchdog/131994-21latency19:16:061
169950,0watchdog/114690-21kthreadcore22:06:051
169950,0watchdog/114398-21munin-node19:31:101
169950,0watchdog/113023-21cut19:51:061
149950,0migration/07129-21cpuspeed_turbos00:06:000
149950,0migration/06059-21gltestperf20:41:100
149950,0migration/04863-21taskset20:38:380
149950,0migration/04365-21kthreadcore21:41:050
149950,0migration/027283-21taskset19:38:420
149950,0migration/026198-21fschecks_count18:51:010
149950,0migration/025947-21taskset21:54:500
149950,0migration/02437-21cpuspeed_turbos22:01:010
149950,0migration/023996-21fschecks_time20:06:010
149950,0migration/023217-21kthreadcore18:46:060
149950,0migration/022507-21kthreadcore21:11:040
149950,0migration/021352-21taskset19:56:150
149950,0migration/017345-21sh22:09:230
149950,0migration/014684-21munin-node19:06:050
149950,0migration/013022-21kthreadcore23:26:050
149950,0migration/012947-21kthreadcore19:26:050
149950,0migration/012402-21kthreadcore21:46:050
149950,0migration/011766-21kthreadcore19:51:050
8215040,0irq/24-0000:00:0-21swapper/222:50:462
8215040,0irq/24-0000:00:0-21swapper/219:55:432
339940,0migration/327001-21kthreadcore23:56:043
339940,0migration/323428-21kthreadcore19:11:053
339940,0migration/32226-21irqrtprio19:21:053
339940,0migration/320654-21runrttasks19:34:143
339940,0migration/320324-21kthreadcore23:51:063
29725040,0irq/27-eth0-tx-30113-21telnet20:11:000
29725040,0irq/27-eth0-tx-25441-21ssh22:35:542
29725040,0irq/27-eth0-tx-0-21swapper/223:20:502
29725040,0irq/27-eth0-tx-0-21swapper/223:01:042
29725040,0irq/27-eth0-tx-0-21swapper/222:57:122
29725040,0irq/27-eth0-tx-0-21swapper/222:02:442
29725040,0irq/27-eth0-tx-0-21swapper/221:40:552
29725040,0irq/27-eth0-tx-0-21swapper/221:32:482
29725040,0irq/27-eth0-tx-0-21swapper/221:32:482
29725040,0irq/27-eth0-tx-0-21swapper/221:25:592
29725040,0irq/27-eth0-tx-0-21swapper/020:16:110
29725040,0irq/27-eth0-tx-0-21swapper/019:31:050
29725040,0irq/27-eth0-tx-0-21swapper/019:15:590
29725040,0irq/27-eth0-tx-0-21swapper/018:55:580
29715040,0irq/26-eth0-rx-0-21swapper/323:01:043
29715040,0irq/26-eth0-rx-0-21swapper/322:50:553
29715040,0irq/26-eth0-rx-0-21swapper/322:41:153
29715040,0irq/26-eth0-rx-0-21swapper/322:06:463
29715040,0irq/26-eth0-rx-0-21swapper/321:25:593
29715040,0irq/26-eth0-rx-0-21swapper/320:55:583
29715040,0irq/26-eth0-rx-0-21swapper/320:35:583
29715040,0irq/26-eth0-rx-0-21swapper/300:06:053
259940,0migration/25084-21hwlatdetect20:16:052
259940,0migration/227610-21munin-node21:36:012
259940,0migration/218449-21kthreadcore19:56:042
259940,0migration/218042-21kthreadcore23:11:032
249940,0watchdog/219251-21tune2fs21:51:012
249940,0watchdog/218011-21kthreadcore19:06:062
249940,0watchdog/20-21swapper/220:36:102
249940,0watchdog/20-21swapper/219:21:062
249940,0watchdog/20-21swapper/219:11:062
189019944,0cyclictest0-21swapper/222:25:492
189019943,0cyclictest3514-21snmpd20:41:022
189019943,0cyclictest3514-21snmpd20:31:022
189019943,0cyclictest3514-21snmpd20:14:172
189019943,0cyclictest3514-21snmpd19:30:172
189019943,0cyclictest3514-21snmpd18:58:472
189009944,0cyclictest0-21swapper/123:48:011
189009944,0cyclictest0-21swapper/122:54:431
189009943,0cyclictest820-21awk18:56:011
189009943,0cyclictest3514-21snmpd23:33:471
189009943,0cyclictest3514-21snmpd23:25:471
189009943,0cyclictest3514-21snmpd23:22:021
189009943,0cyclictest3514-21snmpd22:39:471
189009943,0cyclictest3514-21snmpd20:55:021
189009943,0cyclictest3514-21snmpd20:03:471
189009943,0cyclictest3514-21snmpd19:57:321
189009943,0cyclictest3514-21snmpd19:29:471
189009943,0cyclictest3514-21snmpd19:14:471
189009943,0cyclictest3514-21snmpd19:08:471
189009943,0cyclictest1899-21awk19:21:031
189009943,0cyclictest18438-21awk22:31:021
189009943,0cyclictest17378-21awk23:11:011
189009943,0cyclictest10438-21awk22:26:021
189009942,0cyclictest3514-21snmpd00:11:021
188999944,0cyclictest0-21swapper/023:46:250
188999944,0cyclictest0-21swapper/023:23:240
188999944,0cyclictest0-21swapper/000:12:260
188999943,0cyclictest30713-21sadc20:35:470
188999943,0cyclictest24777-21awk23:36:030
188999943,0cyclictest2420-21awk22:21:010
188999943,0cyclictest22205-21kworker/0:222:41:300
188999943,0cyclictest17382-21sadc20:25:480
188999943,0cyclictest1370-21awk23:01:020
188999943,0cyclictest12307-21awk21:26:020
179940,0migration/14182-21kthreadcore21:41:051
179940,0migration/13504-21kthreadcore20:36:041
179940,0migration/131215-21kthreadcore22:16:041
179940,0migration/125541-21kthreadcore20:06:051
179940,0migration/125102-21idleruntime20:31:051
179940,0migration/123934-21kthreadcore19:36:051
179940,0migration/123055-21latency_hist23:55:461
179940,0migration/112861-21taskset19:02:131
179940,0migration/111658-21cpuspeed_turbos21:26:001
169940,0watchdog/18700-21cpuspeed_turbos23:06:011
169940,0watchdog/14015-21taskset20:15:261
169940,0watchdog/131649-21kthreadcore19:41:061
169940,0watchdog/129975-21kthreadcore18:51:061
169940,0watchdog/128139-21cut23:56:051
169940,0watchdog/126868-21df21:55:571
169940,0watchdog/12611-21perl19:46:021
169940,0watchdog/124805-21ssh21:31:051
169940,0watchdog/124805-21ssh21:31:051
169940,0watchdog/122195-21kthreadcore18:46:061
169940,0watchdog/115117-21kthreadcore20:46:051
169940,0watchdog/113839-21ps21:46:051
169940,0watchdog/10-21swapper/123:36:011
169940,0watchdog/10-21swapper/120:26:141
149940,0migration/030974-21kthreadcore21:36:060
149940,0migration/030376-21kthreadcore19:41:050
149940,0migration/02499-21kthreadcore23:41:050
149940,0migration/024063-21sh22:54:010
149940,0migration/021618-21sensors_fan23:31:080
149940,0migration/012322-21df_inode21:06:000
8215030,0irq/24-0000:00:0-21swapper/220:00:522
8215030,0irq/24-0000:00:0-21swapper/219:00:512
29725030,0irq/27-eth0-tx-6783-21aten2.4-expect19:00:590
29715030,0irq/26-eth0-rx-0-21swapper/320:06:083
29715030,0irq/26-eth0-rx-0-21swapper/320:00:583
29715030,0irq/26-eth0-rx-0-21swapper/319:58:063
29715030,0irq/26-eth0-rx-0-21swapper/319:51:203
29715030,0irq/26-eth0-rx-0-21swapper/319:00:593
29715030,0irq/26-eth0-rx-0-21swapper/318:55:583
29715030,0irq/26-eth0-rx-0-21swapper/318:45:593
259930,0migration/219878-21hddtemp_smartct18:46:022
249930,0watchdog/20-21swapper/219:31:102
249930,0watchdog/20-21swapper/218:51:062
189019932,0cyclictest32557-21sort19:16:102
189019932,0cyclictest21964-21awk19:36:032
189009932,0cyclictest5304-21irqcore20:16:071
189009932,0cyclictest3514-21snmpd22:20:471
189009932,0cyclictest11935-21awk20:21:041
189009931,0cyclictest4343-21cut23:01:041
188999933,0cyclictest22205-21kworker/0:223:55:580
188999933,0cyclictest22205-21kworker/0:223:50:480
188999933,0cyclictest22205-21kworker/0:223:05:500
188999933,0cyclictest22205-21kworker/0:222:26:140
188999933,0cyclictest22205-21kworker/0:222:15:480
188999933,0cyclictest22205-21kworker/0:221:55:500
188999933,0cyclictest22205-21kworker/0:221:30:500
188999933,0cyclictest22205-21kworker/0:221:30:500
188999933,0cyclictest22205-21kworker/0:220:55:570
188999933,0cyclictest22205-21kworker/0:220:50:550
188999933,0cyclictest22205-21kworker/0:220:26:010
169930,0watchdog/10-21swapper/122:45:571
169930,0watchdog/10-21swapper/122:40:571
169930,0watchdog/10-21swapper/121:51:011
29715020,0irq/26-eth0-rx-0-21swapper/320:20:543
29715020,0irq/26-eth0-rx-0-21swapper/320:10:543
29715020,0irq/26-eth0-rx-0-21swapper/319:26:413
249920,0watchdog/20-21swapper/220:05:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional