You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 00:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Sep 07, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
140523727,0sleep30-21swapper/306:43:463
131723627,0sleep10-21swapper/106:42:441
111923423,0sleep00-21swapper/006:40:230
111623425,0sleep20-21swapper/206:40:212
1549991515,0cyclictest31950-21turbostat09:04:350
15549983,0cyclictest17031-21awk08:54:522
15549973,0cyclictest6837-21awk10:29:502
15549973,0cyclictest3556-21lldpd10:27:562
15549973,0cyclictest16128-21awk06:54:522
15549972,0cyclictest29188-21awk11:44:512
15549972,0cyclictest26636-21awk08:39:512
15549972,0cyclictest23164-21awk10:19:502
15549970,0cyclictest0-21swapper/211:54:402
339960,0migration/33399-21sh11:06:113
339960,0migration/328922-21kthreadcore12:04:513
339960,0migration/327703-21sh11:00:443
339960,0migration/327507-21sh11:43:223
339960,0migration/321498-21sh10:18:023
339960,0migration/320122-21sh10:35:253
339960,0migration/317892-21sh11:55:073
339960,0migration/313645-21sh09:51:563
29715060,0irq/26-eth0-rx-22147-21df10:39:483
29715060,0irq/26-eth0-rx-0-21swapper/309:14:333
15549962,0cyclictest6559-21runrttasks08:22:072
15549962,0cyclictest623-21awk09:04:502
15549962,0cyclictest20916-21ssh10:37:452
15549962,0cyclictest20578-21kthreadcore08:09:522
15549962,0cyclictest16751-21awk09:14:502
15549962,0cyclictest12805-21kthreadcore07:39:522
15549960,0cyclictest9178-21irqrtprio08:49:512
15549960,0cyclictest8314-21kthreadcore10:09:522
15549960,0cyclictest7966-21munin-node09:09:502
15549960,0cyclictest7378-21munin-node09:29:522
15549960,0cyclictest7268-21diskstats09:49:482
15549960,0cyclictest6124-21smartctl10:49:492
15549960,0cyclictest4572-21hwlatdetect11:49:492
15549960,0cyclictest346-21awk08:44:482
15549960,0cyclictest32474-21kthreadcore10:04:522
15549960,0cyclictest31634-21grep11:24:522
15549960,0cyclictest30782-21iostat_ios10:44:532
15549960,0cyclictest29409-21ssh11:04:462
15549960,0cyclictest2849-21cut09:44:542
15549960,0cyclictest27583-21munin-node12:04:562
15549960,0cyclictest26517-21cut07:24:542
15549960,0cyclictest25880-21cut08:59:522
15549960,0cyclictest23776-21munin-node09:19:522
15549960,0cyclictest220652sleep207:19:592
15549960,0cyclictest21672-21rm10:18:342
15549960,0cyclictest21206-21cat10:59:352
15549960,0cyclictest14537-21latency_hist09:54:352
15549960,0cyclictest13957-21ntpq06:49:562
15549960,0cyclictest12510-21sh08:29:472
15549960,0cyclictest0-21swapper/211:32:222
15549960,0cyclictest0-21swapper/210:42:252
15549960,0cyclictest0-21swapper/209:25:132
15499960,0cyclictest0-21swapper/012:07:460
339950,0migration/39754-21taskset12:11:173
339950,0migration/3665-21gltestperf08:44:493
339950,0migration/34702-21munin-node07:34:503
339950,0migration/34533-21kthreadcore06:44:543
339950,0migration/34039-21kthreadcore08:19:533
339950,0migration/326407-21munin-node08:39:493
339950,0migration/325493-21kthreadcore09:39:523
339950,0migration/324693-21kthreadcore06:59:533
339950,0migration/324625-21latency_hist08:14:363
339950,0migration/324213-21fschecks_count07:49:493
339950,0migration/321405-21fschecks_time11:19:503
339950,0migration/320709-21kthreadcore08:34:523
339950,0migration/320419-21kthreadcore09:14:533
339950,0migration/318966-21vmstat11:15:003
339950,0migration/315169-21kthreadcore11:34:523
339950,0migration/314131-21latency_hist10:14:353
339950,0migration/313944-21munin-node08:49:593
339950,0migration/311592-21kthreadcore07:14:533
339950,0migration/311485-21latency_hist11:54:353
339950,0migration/311212-21smart_sda10:49:573
29715050,0irq/26-eth0-rx-30328-21grep07:54:363
29715050,0irq/26-eth0-rx-2883-21kthreadcore09:04:533
29715050,0irq/26-eth0-rx-25475-21kthreadcore08:59:533
29715050,0irq/26-eth0-rx-25290-21port_sshpriv11:59:563
29715050,0irq/26-eth0-rx-19752-21kthreadcore09:54:533
29715050,0irq/26-eth0-rx-0-21swapper/311:49:283
29715050,0irq/26-eth0-rx-0-21swapper/310:56:383
29715050,0irq/26-eth0-rx-0-21swapper/310:44:543
29715050,0irq/26-eth0-rx-0-21swapper/310:19:573
29715050,0irq/26-eth0-rx-0-21swapper/309:59:443
29715050,0irq/26-eth0-rx-0-21swapper/309:44:563
29715050,0irq/26-eth0-rx-0-21swapper/309:34:543
29715050,0irq/26-eth0-rx-0-21swapper/308:54:543
19150,0ktimersoftd/10-21swapper/111:54:401
179950,0migration/1929-21kthreadcore10:24:581
179950,0migration/131483-21timerandwakeup08:39:581
179950,0migration/125224-21taskset08:37:011
179950,0migration/119202-21kthreadcore07:44:521
179950,0migration/114631-21sh09:33:181
179950,0migration/110654-21cpuspeed_turbos07:39:481
15549951,0cyclictest5787-21aten2.4-expect08:24:492
15549951,0cyclictest2637-21date07:09:362
15549951,0cyclictest0-21swapper/208:14:472
15549951,0cyclictest0-21swapper/207:59:442
15549950,0cyclictest9738-21df07:14:482
15549950,0cyclictest4787-21ssh11:09:372
15549950,0cyclictest4011-21munin-node07:34:472
15549950,0cyclictest3184-21aten_r1power_fr12:09:462
15549950,0cyclictest30595-21cpuspeed_turbos07:54:482
15549950,0cyclictest29497-21munin-node07:29:482
15549950,0cyclictest28507-21aten_r1power_en07:04:472
15549950,0cyclictest24001-21cpuspeed_turbos07:49:482
15549950,0cyclictest23180-21grep09:39:352
15549950,0cyclictest22883-21sh09:59:472
15549950,0cyclictest22134-21df_abs06:59:492
15549950,0cyclictest20634-21ls11:19:352
15549950,0cyclictest19948-21latency_hist11:39:352
15549950,0cyclictest18961-21latency_hist08:34:362
15549950,0cyclictest1776-21aten_r1power_cu06:44:482
15549950,0cyclictest17167-21aten2.4-expect07:44:472
15549950,0cyclictest16239-21awk09:34:512
15549950,0cyclictest13370-21munin-node10:54:452
15549950,0cyclictest12753-21cut11:14:352
15549950,0cyclictest12313-21aten_r1power_cu11:34:462
15549950,0cyclictest11803-21cat08:04:482
15549950,0cyclictest0-21swapper/211:59:372
15509950,0cyclictest0-21swapper/110:44:351
15499955,0cyclictest0-21swapper/012:03:300
15499955,0cyclictest0-21swapper/011:35:550
15499955,0cyclictest0-21swapper/010:17:240
15499955,0cyclictest0-21swapper/008:24:500
15499954,0cyclictest3241-21irqbalance10:14:040
15499954,0cyclictest14547-21grep10:54:500
15499950,0cyclictest0-21swapper/011:14:380
15499950,0cyclictest0-21swapper/010:36:570
15499950,0cyclictest0-21swapper/009:32:090
149950,0migration/03846-21aten_r1power_fr11:49:460
149950,0migration/03178-21kthreadcore06:44:530
149950,0migration/031598-21kernelversion10:24:570
149950,0migration/031362-21sendmail_mailqu08:39:560
149950,0migration/028658-21switchtime09:59:580
149950,0migration/023957-21kthreadcore10:59:520
149950,0migration/022585-21kthreadcore08:09:530
149950,0migration/014510-21kthreadcore08:29:520
149950,0migration/014228-21kthreadcore07:14:540
149950,0migration/010013-21kthreadcore09:09:530
339940,0migration/35145-21kthreadcore07:09:523
339940,0migration/310020-21kthreadcore08:24:563
29725040,0irq/27-eth0-tx-0-21swapper/008:44:530
29725040,0irq/27-eth0-tx-0-21swapper/006:54:580
29715040,0irq/26-eth0-rx-13253-21cut08:04:523
29715040,0irq/26-eth0-rx-0-21swapper/311:29:523
29715040,0irq/26-eth0-rx-0-21swapper/311:27:293
29715040,0irq/26-eth0-rx-0-21swapper/311:10:083
29715040,0irq/26-eth0-rx-0-21swapper/310:29:523
29715040,0irq/26-eth0-rx-0-21swapper/310:24:433
29715040,0irq/26-eth0-rx-0-21swapper/310:04:533
29715040,0irq/26-eth0-rx-0-21swapper/309:29:573
29715040,0irq/26-eth0-rx-0-21swapper/309:24:493
29715040,0irq/26-eth0-rx-0-21swapper/309:21:573
29715040,0irq/26-eth0-rx-0-21swapper/307:29:523
29715040,0irq/26-eth0-rx-0-21swapper/306:54:533
179940,0migration/15445-21kthreadcore06:44:541
179940,0migration/13965-21hwlatdetect12:09:491
179940,0migration/129938-21irqrtprio11:24:511
179940,0migration/129414-21aten_r1power_cu07:29:471
179940,0migration/128370-21hddtemp_smartct12:04:481
179940,0migration/127497-21kthreadcore08:59:531
179940,0migration/125623-21kthreadcore07:49:531
179940,0migration/12392-21runrttasks11:04:541
179940,0migration/121842-21fschecks_count10:59:481
179940,0migration/11991-21runrttasks11:45:111
179940,0migration/119817-21timerwakeupswit10:34:581
179940,0migration/119020-21if_eth1.308:09:511
179940,0migration/118234-21kthreadcore10:14:541
179940,0migration/115338-21runrttasks09:34:441
179940,0migration/112777-21latency_hist11:14:351
179940,0migration/11031-21irqrtprio09:04:521
179940,0migration/110168-21kthreadcore06:49:531
169940,0watchdog/15528-21ksmtuned08:44:541
169940,0watchdog/13678-21munin-node07:34:461
169940,0watchdog/131743-21ssh09:24:461
169940,0watchdog/130388-21sensors08:14:581
169940,0watchdog/129697-21ssh10:02:141
169940,0watchdog/126306-21kthreadcore10:39:541
169940,0watchdog/123367-21kthreadcore11:39:531
169940,0watchdog/120227-21memory09:54:541
169940,0watchdog/115891-21aten2.4-expect09:14:461
169940,0watchdog/111630-21chrt10:50:101
169940,0watchdog/110109-21ssh11:50:331
169940,0watchdog/10-21swapper/108:50:501
15509944,0cyclictest0-21swapper/108:54:521
15509943,0cyclictest8968-21awk09:09:521
15509943,0cyclictest7716-21awk09:49:491
15509943,0cyclictest7230-21awk10:09:501
15509943,0cyclictest6705-21awk10:29:491
15509943,0cyclictest6643-21awk08:24:521
15509943,0cyclictest3569-21awk07:09:501
15509943,0cyclictest3556-21lldpd10:23:271
15509943,0cyclictest3556-21lldpd10:04:561
15509943,0cyclictest32252-21awk09:44:521
15509943,0cyclictest24703-21awk09:19:501
15509943,0cyclictest15986-21awk06:54:511
15509940,0cyclictest0-21swapper/110:59:061
15499944,0cyclictest0-21swapper/009:16:230
15499943,0cyclictest9252-21gltestperf06:49:500
15499943,0cyclictest5273-21awk11:29:510
15499943,0cyclictest3556-21lldpd08:56:260
15499943,0cyclictest3514-21snmpd10:31:040
15499943,0cyclictest3514-21snmpd08:03:180
15499943,0cyclictest3241-21irqbalance12:11:130
15499943,0cyclictest3241-21irqbalance11:45:530
15499943,0cyclictest3241-21irqbalance09:44:440
15499943,0cyclictest3241-21irqbalance09:39:440
15499943,0cyclictest3241-21irqbalance08:53:040
15499943,0cyclictest31645-21awk10:04:500
15499943,0cyclictest29523-21awk11:24:490
15499943,0cyclictest22681-21awk06:59:510
15499943,0cyclictest19911-21awk08:34:500
15499943,0cyclictest13482-21kthreadcore07:39:530
15499943,0cyclictest12264-21awk08:04:500
15499942,0cyclictest3241-21irqbalance10:49:540
149940,0migration/06468-21kthreadcore11:09:510
149940,0migration/032592-21kthreadcore11:04:520
149940,0migration/031387-21kthreadcore07:29:530
149940,0migration/030193-21fschecks_count10:44:500
149940,0migration/029158-21ntp_kernel_err07:49:550
149940,0migration/028359-21unixbench_multi10:19:580
149940,0migration/025682-21munin-node08:14:510
149940,0migration/024873-21irqcore09:19:510
149940,0migration/022762-21switchtime07:44:580
149940,0migration/022126-21kthreadcore11:19:540
149940,0migration/018721-21kthreadcore07:19:530
149940,0migration/016401-21kthreadcore09:54:520
149940,0migration/015240-21latency_hist09:34:350
149940,0migration/013465-21kthreadcore11:54:520
339930,0migration/323846-21timerandwakeup08:09:583
339930,0migration/312458-21kthreadcore07:39:523
29715030,0irq/26-eth0-rx-0-21swapper/308:31:323
29715030,0irq/26-eth0-rx-0-21swapper/307:59:483
29715030,0irq/26-eth0-rx-0-21swapper/307:44:473
29715030,0irq/26-eth0-rx-0-21swapper/307:24:413
29715030,0irq/26-eth0-rx-0-21swapper/307:22:203
29715030,0irq/26-eth0-rx-0-21swapper/306:50:053
179930,0migration/14408-21aten_r1power_po11:29:471
169930,0watchdog/10-21swapper/111:34:571
169930,0watchdog/10-21swapper/111:21:011
169930,0watchdog/10-21swapper/111:12:491
169930,0watchdog/10-21swapper/109:41:541
169930,0watchdog/10-21swapper/107:59:541
169930,0watchdog/10-21swapper/107:04:541
15509932,0cyclictest351-21tr07:54:531
15509932,0cyclictest32241-21awk08:19:501
15509932,0cyclictest16948-21awk07:19:511
15509932,0cyclictest13204-21awk08:29:491
15509932,0cyclictest10299-21awk07:14:511
15509931,0cyclictest0-21swapper/106:59:531
15509930,0cyclictest26374-21cut07:24:541
15509930,0cyclictest20239-21perl11:59:491
15499933,0cyclictest0-21swapper/010:40:350
15499932,0cyclictest5365-21ksmtuned08:23:540
15499932,0cyclictest4000-21grep07:09:520
15499932,0cyclictest3514-21snmpd09:05:480
15499932,0cyclictest31211-21awk07:54:500
15499932,0cyclictest30103-21cut07:04:530
15499932,0cyclictest22832-21basename07:24:480
15499930,0cyclictest8324-21kthreadcore09:49:510
149930,0migration/04659-21kthreadcore09:24:550
149930,0migration/03677-21runrttasks07:34:450
149930,0migration/026422-21sh11:40:050
29715020,0irq/26-eth0-rx-0-21swapper/307:04:473
15509920,0cyclictest11371-21latency_hist08:04:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional