You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 07:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Mar 11, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
449724637,0sleep10-21swapper/118:59:011
447723727,0sleep30-21swapper/318:58:473
3073923430,0sleep00-21swapper/018:56:560
469123127,0sleep20-21swapper/219:01:182
480699110,0cyclictest0-21swapper/221:03:042
48059970,0cyclictest0-21swapper/122:02:001
48059960,0cyclictest0-21swapper/123:58:301
48049960,0cyclictest9908-21ssh21:43:280
48049960,0cyclictest0-21swapper/021:56:240
48049960,0cyclictest0-21swapper/000:21:550
4160,0ktimersoftd/00-21swapper/021:38:440
339960,0migration/39092-21sh23:05:193
339960,0migration/32962-21munin-node22:42:003
339960,0migration/327602-21munin-node22:16:563
339960,0migration/325628-21sh22:13:483
339960,0migration/318297-21sh21:09:063
339960,0migration/317999-21sh21:48:493
339960,0migration/31609-21sh21:17:323
339960,0migration/315591-21sh00:30:233
339960,0migration/315257-21sh23:47:143
339960,0migration/31040-21sh23:21:383
29725060,0irq/27-eth0-tx-0-21swapper/019:45:590
29715060,0irq/26-eth0-rx-3856-21kthreadcore22:21:593
29715060,0irq/26-eth0-rx-31629-21ssh23:37:213
29715060,0irq/26-eth0-rx-14476-21tr22:47:033
29715060,0irq/26-eth0-rx-13763-21kthreadcore22:07:023
29715060,0irq/26-eth0-rx-0-21swapper/321:24:193
149960,0migration/020125-21gltestperf19:36:570
149960,0migration/014695-21sh00:27:450
149960,0migration/01128-21sh23:00:470
48059955,0cyclictest3024-21diskmemload22:51:111
48059955,0cyclictest0-21swapper/100:03:331
48059950,0cyclictest0-21swapper/122:58:361
48049955,0cyclictest3024-21diskmemload23:35:430
48049955,0cyclictest0-21swapper/022:11:130
48049955,0cyclictest0-21swapper/000:06:470
48049950,0cyclictest0-21swapper/022:40:040
48049950,0cyclictest0-21swapper/022:18:380
48049950,0cyclictest0-21swapper/000:01:440
4150,0ktimersoftd/00-21swapper/022:02:140
4150,0ktimersoftd/00-21swapper/021:21:050
339950,0migration/39968-21irqrtprio00:07:003
339950,0migration/39599-21munin-node23:26:563
339950,0migration/329359-21kthreadcore20:07:023
339950,0migration/325066-21munin-node19:37:063
339950,0migration/324812-21kthreadcore20:27:023
339950,0migration/323379-21kthreadcore20:02:013
339950,0migration/319644-21munin-node21:31:553
339950,0migration/317489-21munin-node00:11:583
339950,0migration/310663-21kthreadcore20:16:593
29725050,0irq/27-eth0-tx-9466-21munin-node23:27:002
29725050,0irq/27-eth0-tx-25012-21ssh23:15:182
29725050,0irq/27-eth0-tx-24659-21munin-node00:16:572
29725050,0irq/27-eth0-tx-19632-21munin-node21:32:022
29725050,0irq/27-eth0-tx-19145-21ssh21:31:072
29725050,0irq/27-eth0-tx-12026-21gltestperf21:46:572
29725050,0irq/27-eth0-tx-0-21swapper/223:58:052
29725050,0irq/27-eth0-tx-0-21swapper/223:55:522
29725050,0irq/27-eth0-tx-0-21swapper/223:48:032
29725050,0irq/27-eth0-tx-0-21swapper/223:44:062
29725050,0irq/27-eth0-tx-0-21swapper/223:08:052
29725050,0irq/27-eth0-tx-0-21swapper/222:48:232
29725050,0irq/27-eth0-tx-0-21swapper/222:09:182
29725050,0irq/27-eth0-tx-0-21swapper/222:01:542
29725050,0irq/27-eth0-tx-0-21swapper/221:23:122
29725050,0irq/27-eth0-tx-0-21swapper/221:13:252
29725050,0irq/27-eth0-tx-0-21swapper/020:56:180
29725050,0irq/27-eth0-tx-0-21swapper/020:36:590
29725050,0irq/27-eth0-tx-0-21swapper/020:32:040
29725050,0irq/27-eth0-tx-0-21swapper/019:36:030
29725050,0irq/27-eth0-tx-0-21swapper/019:07:180
29715050,0irq/26-eth0-rx-25313-21ssh23:16:123
29715050,0irq/26-eth0-rx-24083-21tr21:52:013
29715050,0irq/26-eth0-rx-19286-21kthreadcore23:32:003
29715050,0irq/26-eth0-rx-18847-21gltestperf22:51:563
29715050,0irq/26-eth0-rx-1377-21ssh21:58:183
29715050,0irq/26-eth0-rx-1088-21latency_hist23:21:433
29715050,0irq/26-eth0-rx-0-21swapper/323:56:563
29715050,0irq/26-eth0-rx-0-21swapper/323:55:223
29715050,0irq/26-eth0-rx-0-21swapper/323:46:203
29715050,0irq/26-eth0-rx-0-21swapper/322:37:053
29715050,0irq/26-eth0-rx-0-21swapper/322:32:003
29715050,0irq/26-eth0-rx-0-21swapper/322:03:113
29715050,0irq/26-eth0-rx-0-21swapper/321:41:563
29715050,0irq/26-eth0-rx-0-21swapper/321:12:313
29715050,0irq/26-eth0-rx-0-21swapper/320:22:023
29715050,0irq/26-eth0-rx-0-21swapper/319:51:583
29715050,0irq/26-eth0-rx-0-21swapper/300:23:343
259950,0migration/28776-21missed_timers21:42:032
259950,0migration/28277-21munin-node22:22:042
259950,0migration/27614-21taskset00:25:262
259950,0migration/26765-21unixbench_multi00:02:062
259950,0migration/232717-21irqcore19:21:592
259950,0migration/228131-21kthreadcore22:36:592
259950,0migration/214548-21switchtime00:07:072
249950,0watchdog/26610-21tune2fs19:26:592
249950,0watchdog/211924-21fschecks_count21:06:582
19150,0ktimersoftd/13024-21diskmemload21:38:441
19150,0ktimersoftd/10-21swapper/123:06:191
179950,0migration/18997-21ntp_offset21:22:031
179950,0migration/17653-21munin-node20:37:021
179950,0migration/16835-21munin-node23:42:041
179950,0migration/131381-21pmu-power23:17:041
179950,0migration/131187-21kthreadcore20:32:011
179950,0migration/129762-21kthreadcore21:17:001
179950,0migration/126639-21sh21:55:401
179950,0migration/123315-21kthreadcore20:02:011
179950,0migration/119230-21gltestperf22:31:561
179950,0migration/118626-21sh21:50:401
179950,0migration/11369-21aten_r1power_cu23:21:531
179950,0migration/11102-21sh21:57:301
169950,0watchdog/12350-21grep20:57:061
149950,0migration/09047-21kthreadcore19:52:020
149950,0migration/07408-21munin-node23:02:030
149950,0migration/06608-21kthreadcore22:42:030
149950,0migration/027172-21sh21:36:190
149950,0migration/024914-21latency_hist19:16:440
149950,0migration/022744-21kthreadcore22:52:000
149950,0migration/021478-21irqcore20:02:000
149950,0migration/019766-21kthreadcore23:12:000
149950,0migration/01761-21sh21:59:270
149950,0migration/017017-21munin-node21:07:050
149950,0migration/013773-21kthreadcore23:47:020
149950,0migration/010609-21taskset21:24:400
8215040,0irq/24-0000:00:1461-21latency_hist23:01:442
48069943,0cyclictest8876-21awk20:16:572
48069943,0cyclictest7845-21awk19:51:592
48069943,0cyclictest3556-21lldpd19:38:112
48069943,0cyclictest3514-21snmpd23:21:532
48069943,0cyclictest3514-21snmpd20:51:532
48069943,0cyclictest3514-21snmpd20:49:082
48069943,0cyclictest3514-21snmpd20:43:082
48069943,0cyclictest3514-21snmpd20:33:082
48069943,0cyclictest3514-21snmpd20:27:382
48069943,0cyclictest3514-21snmpd20:00:082
48069943,0cyclictest3514-21snmpd19:32:082
48069943,0cyclictest3514-21snmpd19:19:082
48069943,0cyclictest3514-21snmpd19:07:082
48069943,0cyclictest3514-21snmpd19:02:082
48069943,0cyclictest27917-21awk20:07:002
48069943,0cyclictest18481-21awk23:31:592
48059944,0cyclictest0-21swapper/123:11:501
48059944,0cyclictest0-21swapper/122:43:461
48059943,0cyclictest3556-21lldpd23:29:431
48059943,0cyclictest3514-21snmpd20:14:531
48059943,0cyclictest3514-21snmpd19:23:381
48059943,0cyclictest26358-21awk23:36:581
48059943,0cyclictest1126-21awk19:46:581
48049944,0cyclictest0-21swapper/023:41:330
48049943,0cyclictest9890-21awk20:42:000
48049943,0cyclictest3556-21lldpd23:56:430
48049943,0cyclictest3556-21lldpd00:11:430
48049943,0cyclictest3241-21irqbalance23:52:520
48049943,0cyclictest3241-21irqbalance23:26:520
48049943,0cyclictest3241-21irqbalance23:25:320
48049943,0cyclictest3241-21irqbalance21:27:020
48049943,0cyclictest3241-21irqbalance20:22:030
48049943,0cyclictest3241-21irqbalance19:22:030
48049943,0cyclictest26806-21sed23:16:590
48049943,0cyclictest19496-21awk22:31:580
48049943,0cyclictest16570-21awk20:46:590
48049943,0cyclictest1141-21awk19:46:580
48049943,0cyclictest10856-21awk23:06:590
48049940,0cyclictest0-21swapper/020:56:560
339940,0migration/34365-21kthreadcore19:22:013
339940,0migration/325183-21kthreadcore20:52:003
339940,0migration/322653-21kthreadcore19:12:023
339940,0migration/32030-21latency_hist20:36:443
339940,0migration/314494-21kthreadcore23:07:013
339940,0migration/31416-21irqcore19:47:003
339940,0migration/310700-21kthreadcore19:27:033
29725040,0irq/27-eth0-tx-27693-21ssh21:16:522
29725040,0irq/27-eth0-tx-19321-21df_abs22:11:562
29725040,0irq/27-eth0-tx-0-21swapper/222:56:462
29725040,0irq/27-eth0-tx-0-21swapper/222:54:462
29725040,0irq/27-eth0-tx-0-21swapper/222:31:452
29725040,0irq/27-eth0-tx-0-21swapper/222:26:592
29725040,0irq/27-eth0-tx-0-21swapper/221:52:062
29725040,0irq/27-eth0-tx-0-21swapper/221:36:512
29725040,0irq/27-eth0-tx-0-21swapper/200:26:562
29725040,0irq/27-eth0-tx-0-21swapper/020:27:120
29725040,0irq/27-eth0-tx-0-21swapper/019:17:040
29725040,0irq/27-eth0-tx-0-21swapper/019:02:000
29715040,0irq/26-eth0-rx-16764-21kthreadcore19:57:023
29715040,0irq/26-eth0-rx-0-21swapper/322:56:553
29715040,0irq/26-eth0-rx-0-21swapper/322:28:513
29715040,0irq/26-eth0-rx-0-21swapper/321:36:543
29715040,0irq/26-eth0-rx-0-21swapper/321:28:323
29715040,0irq/26-eth0-rx-0-21swapper/321:01:463
29715040,0irq/26-eth0-rx-0-21swapper/320:42:023
29715040,0irq/26-eth0-rx-0-21swapper/320:41:113
29715040,0irq/26-eth0-rx-0-21swapper/319:01:563
29715040,0irq/26-eth0-rx-0-21swapper/300:17:253
29715040,0irq/26-eth0-rx-0-21swapper/300:01:593
259940,0migration/2870-21unixbench_multi21:57:062
259940,0migration/26076-21kthreadcore20:37:012
259940,0migration/25028-21kthreadcore22:42:022
259940,0migration/24797-21kthreadcore20:12:012
259940,0migration/24451-21kthreadcore19:47:012
259940,0migration/232260-21kthreadcore20:57:012
259940,0migration/228120-21kthreadcore19:42:012
259940,0migration/227695-21kthreadcore23:37:002
259940,0migration/223021-21kthreadcore20:02:012
259940,0migration/221158-21kthreadcore00:12:012
249940,0watchdog/231178-21memory23:17:022
249940,0watchdog/218586-21kthreadcore20:22:022
249940,0watchdog/20-21swapper/222:16:462
23687240,0sleep123692-21rm23:53:331
179940,0migration/17486-21sh00:25:031
179940,0migration/14092-21munin-node21:01:581
179940,0migration/128688-21taskset20:56:061
179940,0migration/127511-21fschecks_count20:06:581
179940,0migration/125605-21runrttasks22:13:431
179940,0migration/122825-21kthreadcore19:12:021
179940,0migration/119861-21kthreadcore23:32:001
179940,0migration/119776-21aten_r1power_vo21:11:541
179940,0migration/118354-21munin-node22:51:541
179940,0migration/114819-21irqcore19:57:001
179940,0migration/114702-21kthreadcore23:07:011
179940,0migration/114457-21kthreadcore19:07:001
179940,0migration/113902-21kthreadcore23:47:021
179940,0migration/113181-21kthreadcore00:27:021
179940,0migration/112714-21kthreadcore20:42:021
179940,0migration/11141-21runrttasks22:18:401
169940,0watchdog/126633-21cpu22:36:541
169940,0watchdog/119431-21basename19:36:551
169940,0watchdog/115160-21ssh00:08:021
169940,0watchdog/115122-21tr22:07:021
169940,0watchdog/10-21swapper/122:26:381
169940,0watchdog/10-21swapper/121:07:021
169940,0watchdog/10-21swapper/120:16:581
169940,0watchdog/10-21swapper/119:26:591
169940,0watchdog/10-21swapper/119:02:071
149940,0migration/09066-21sh22:23:170
149940,0migration/08787-21sh20:16:560
149940,0migration/03331-21aten_r1power_en21:01:550
149940,0migration/031422-21kthreadcore20:07:030
149940,0migration/022554-21kthreadcore22:12:010
149940,0migration/014607-21kthreadcore21:47:010
48069932,0cyclictest19265-21awk19:12:002
48059933,0cyclictest27731-21sadc20:31:441
48059933,0cyclictest17675-21awk00:11:591
48059932,0cyclictest3556-21lldpd19:54:121
48059932,0cyclictest28990-21kthreadcore19:42:011
48059930,0cyclictest0-21swapper/120:50:161
48049933,0cyclictest17074-21kworker/0:223:43:510
48049933,0cyclictest17074-21kworker/0:222:46:450
48049933,0cyclictest17074-21kworker/0:200:18:070
48049933,0cyclictest13618-21kworker/0:121:13:010
48049933,0cyclictest13618-21kworker/0:120:12:080
48049933,0cyclictest13618-21kworker/0:119:57:020
48049932,0cyclictest6908-21awk19:27:000
48049932,0cyclictest13502-21kthreadcore22:27:000
29715030,0irq/26-eth0-rx-0-21swapper/321:00:393
29715030,0irq/26-eth0-rx-0-21swapper/320:46:443
29715030,0irq/26-eth0-rx-0-21swapper/319:43:123
29715030,0irq/26-eth0-rx-0-21swapper/319:31:563
29715030,0irq/26-eth0-rx-0-21swapper/319:17:033
29715030,0irq/26-eth0-rx-0-21swapper/319:07:433
179930,0migration/128164-21kthreadcore00:17:001
179930,0migration/117866-21kthreadcore19:32:021
179930,0migration/114549-21kthreadcore22:27:001
179930,0migration/113887-21kthreadcore21:27:011
169930,0watchdog/118588-21kthreadcore20:22:021
169930,0watchdog/10-21swapper/121:42:501
169930,0watchdog/10-21swapper/121:31:581
169930,0watchdog/10-21swapper/119:16:551
29715020,0irq/26-eth0-rx-0-21swapper/320:11:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional