You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 12:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu May 07, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
457523925,0sleep00-21swapper/018:55:080
304450350,0irq/25-eth10-21swapper/318:51:473
459423324,0sleep10-21swapper/118:55:211
457223224,0sleep20-21swapper/218:55:062
47549976,0cyclictest0-21swapper/220:16:392
47539965,0cyclictest27571-21crond20:26:221
47539960,0cyclictest25360-21diskstats19:11:361
339960,0migration/39513-21sh23:18:353
339960,0migration/323473-21kthreadcore23:46:393
339960,0migration/32327-21sh22:35:133
339960,0migration/316832-21sh00:02:593
29725060,0irq/27-eth0-tx-0-21swapper/222:21:222
29715060,0irq/26-eth0-rx-6559-21runrttasks23:07:063
29715060,0irq/26-eth0-rx-20602-21irqcore21:06:373
29715060,0irq/26-eth0-rx-18306-21rm22:03:113
29715060,0irq/26-eth0-rx-17690-21port_sshpriv21:21:423
29715060,0irq/26-eth0-rx-14704-21kthreadcore21:41:393
149960,0migration/017749-21taskset23:03:470
149960,0migration/017328-21sh00:24:530
149960,0migration/010817-21sh22:20:270
47549955,0cyclictest2870-21diskmemload23:02:592
47549954,0cyclictest3556-21lldpd21:51:102
47549950,0cyclictest0-21swapper/223:52:292
47549950,0cyclictest0-21swapper/223:19:322
47549950,0cyclictest0-21swapper/222:55:062
47549950,0cyclictest0-21swapper/221:22:142
47539955,0cyclictest2870-21diskmemload21:50:021
47539955,0cyclictest0-21swapper/123:47:301
47539955,0cyclictest0-21swapper/123:43:521
47539955,0cyclictest0-21swapper/122:17:001
47539950,0cyclictest0-21swapper/122:51:221
47539950,0cyclictest0-21swapper/122:21:441
47539950,0cyclictest0-21swapper/121:36:101
47539950,0cyclictest0-21swapper/100:13:301
47529955,0cyclictest0-21swapper/000:01:370
47529950,0cyclictest0-21swapper/022:00:510
35150,0ktimersoftd/30-21swapper/321:54:233
339950,0migration/37257-21kthreadcore23:36:383
339950,0migration/34726-21kthreadcore22:36:373
339950,0migration/332465-21kthreadcore22:11:393
339950,0migration/330610-21kthreadcore20:51:393
339950,0migration/327903-21irqcore23:31:363
339950,0migration/32330-21irqrtprio20:06:373
339950,0migration/320244-21aten_r1power_fr21:26:323
339950,0migration/316746-21irqrtprio20:41:383
339950,0migration/310833-21aten_r1power_fr23:21:323
339950,0migration/310491-21munin-node18:56:413
29725050,0irq/27-eth0-tx-20220-21munin-node19:56:340
29725050,0irq/27-eth0-tx-1112-21munin-node20:06:360
29725050,0irq/27-eth0-tx-0-21swapper/020:56:330
29715050,0irq/26-eth0-rx-8274-21kthreadcore21:16:373
29715050,0irq/26-eth0-rx-7839-21sensors00:16:423
29715050,0irq/26-eth0-rx-3775-21if_eth122:56:343
29715050,0irq/26-eth0-rx-32124-21sed23:51:403
29715050,0irq/26-eth0-rx-30134-21tr21:11:393
29715050,0irq/26-eth0-rx-26709-21df_abs00:11:333
29715050,0irq/26-eth0-rx-24617-21ssh00:07:113
29715050,0irq/26-eth0-rx-15947-21grep21:01:403
29715050,0irq/26-eth0-rx-1416-21sh22:53:143
29715050,0irq/26-eth0-rx-13892-21grep00:21:373
29715050,0irq/26-eth0-rx-11387-21cpuspeed_turbos22:41:343
29715050,0irq/26-eth0-rx-0-21swapper/323:41:413
29715050,0irq/26-eth0-rx-0-21swapper/323:01:383
29715050,0irq/26-eth0-rx-0-21swapper/322:51:013
29715050,0irq/26-eth0-rx-0-21swapper/322:23:583
29715050,0irq/26-eth0-rx-0-21swapper/322:18:573
29715050,0irq/26-eth0-rx-0-21swapper/322:09:043
29715050,0irq/26-eth0-rx-0-21swapper/321:47:223
29715050,0irq/26-eth0-rx-0-21swapper/321:39:253
29715050,0irq/26-eth0-rx-0-21swapper/319:26:393
27150,0ktimersoftd/20-21swapper/221:54:232
27150,0ktimersoftd/20-21swapper/219:16:352
27150,0ktimersoftd/20-21swapper/200:15:092
249950,0watchdog/227886-21aten_r1power_cu21:11:322
19150,0ktimersoftd/10-21swapper/121:54:231
179950,0migration/117749-21taskset00:05:371
179950,0migration/112191-21kthreadcore00:21:371
149950,0migration/09595-21kthreadcore20:11:380
149950,0migration/09569-21sendmail_mailtr21:16:410
149950,0migration/07641-21kthreadcore22:36:380
149950,0migration/05022-21irqcore21:36:370
149950,0migration/0337-21kthreadcore22:11:390
149950,0migration/031770-21kthreadcore20:01:400
149950,0migration/030733-21kthreadcore23:31:380
149950,0migration/030270-21kthreadcore23:51:370
149950,0migration/03021-21sh21:55:300
149950,0migration/028848-21aten_r1power_cu20:51:330
149950,0migration/028341-21fschecks_count21:11:350
149950,0migration/028099-21kthreadcore00:11:370
149950,0migration/027872-21switchtime20:46:460
149950,0migration/025588-21pmu-power21:46:430
149950,0migration/025411-21rt-features22:06:400
149950,0migration/024402-21kthreadcore22:26:380
149950,0migration/021889-21gltestperf20:21:360
149950,0migration/021545-21kthreadcore21:06:380
149950,0migration/020428-21cpuspeed_turbos21:26:330
149950,0migration/019386-21cpuspeed_turbos22:46:330
149950,0migration/018909-21sh23:06:290
149950,0migration/018850-21sh21:44:020
149950,0migration/017835-21kthreadcore20:41:380
149950,0migration/016088-21kthreadcore22:21:380
149950,0migration/014979-21fschecks_count20:16:350
149950,0migration/01457-21rt-features21:31:420
149950,0migration/013995-21kthreadcore19:01:380
149950,0migration/013498-21if_eth019:26:360
149950,0migration/013046-21kthreadcore20:36:390
149950,0migration/012301-21fschecks_time22:01:350
149950,0migration/011350-21taskset19:00:380
47549944,0cyclictest0-21swapper/221:06:472
47549943,0cyclictest6891-21awk19:21:372
47549943,0cyclictest5875-21awk18:56:362
47549943,0cyclictest3556-21lldpd23:46:402
47549943,0cyclictest3556-21lldpd21:36:412
47549943,0cyclictest3556-21lldpd20:01:112
47549943,0cyclictest3514-21snmpd21:04:082
47549943,0cyclictest3514-21snmpd21:01:082
47549943,0cyclictest3241-21irqbalance23:06:502
47549943,0cyclictest3241-21irqbalance21:16:302
47549943,0cyclictest3241-21irqbalance19:42:112
47549943,0cyclictest3241-21irqbalance19:37:012
47549943,0cyclictest3241-21irqbalance19:31:512
47549943,0cyclictest3241-21irqbalance19:26:512
47549943,0cyclictest3241-21irqbalance19:11:312
47549943,0cyclictest3241-21irqbalance19:06:312
47549943,0cyclictest3241-21irqbalance19:01:312
47549943,0cyclictest27689-21awk23:31:352
47549943,0cyclictest27580-21sadc20:26:222
47549943,0cyclictest19631-21awk23:26:352
47549943,0cyclictest19200-21awk00:06:362
47549943,0cyclictest12590-21awk22:01:362
47549943,0cyclictest10970-21awk00:21:352
47549940,0cyclictest19685-21munin-node22:06:352
47539944,0cyclictest0-21swapper/123:16:261
47539944,0cyclictest0-21swapper/123:02:051
47539944,0cyclictest0-21swapper/122:40:201
47539943,0cyclictest3742-21awk22:56:341
47539943,0cyclictest3556-21lldpd23:13:101
47539943,0cyclictest3556-21lldpd22:48:111
47539943,0cyclictest3556-21lldpd22:14:411
47539943,0cyclictest3556-21lldpd22:03:411
47539943,0cyclictest3556-21lldpd21:06:411
47539943,0cyclictest3556-21lldpd21:01:411
47539943,0cyclictest3556-21lldpd20:19:411
47539943,0cyclictest3556-21lldpd19:24:401
47539943,0cyclictest3556-21lldpd19:02:101
47539943,0cyclictest2944-21awk20:31:361
47539943,0cyclictest2927-21awk00:16:361
47539943,0cyclictest28719-21awk20:26:361
47539943,0cyclictest21106-21awk21:26:361
47539943,0cyclictest20598-21awk22:06:341
47539943,0cyclictest19170-21awk00:06:361
47529944,0cyclictest4912-21sensors19:16:440
47529944,0cyclictest0-21swapper/023:42:040
47529944,0cyclictest0-21swapper/022:32:130
47529943,0cyclictest8606-21latency_hist20:36:220
47529943,0cyclictest6789-21awk19:21:360
47529943,0cyclictest3824-21awk22:56:350
47529943,0cyclictest3241-21irqbalance22:54:500
47529943,0cyclictest26850-21awk19:36:350
47529943,0cyclictest25894-21awk19:11:380
47529943,0cyclictest19646-21awk23:26:350
47529943,0cyclictest1095-21awk19:41:370
339940,0migration/326959-21kthreadcore20:46:413
339940,0migration/310957-21kthreadcore20:36:383
29725040,0irq/27-eth0-tx-3341-21ssh22:16:322
29725040,0irq/27-eth0-tx-18336-21aten2.4-expect19:06:320
29725040,0irq/27-eth0-tx-13665-21cat22:41:392
29725040,0irq/27-eth0-tx-0-21swapper/223:41:342
29725040,0irq/27-eth0-tx-0-21swapper/223:36:432
29725040,0irq/27-eth0-tx-0-21swapper/223:15:182
29725040,0irq/27-eth0-tx-0-21swapper/222:47:452
29725040,0irq/27-eth0-tx-0-21swapper/222:36:352
29725040,0irq/27-eth0-tx-0-21swapper/222:31:342
29725040,0irq/27-eth0-tx-0-21swapper/222:26:422
29725040,0irq/27-eth0-tx-0-21swapper/222:11:392
29725040,0irq/27-eth0-tx-0-21swapper/221:56:262
29725040,0irq/27-eth0-tx-0-21swapper/221:42:012
29725040,0irq/27-eth0-tx-0-21swapper/221:31:322
29725040,0irq/27-eth0-tx-0-21swapper/221:26:222
29715040,0irq/26-eth0-rx-0-21swapper/323:56:353
29715040,0irq/26-eth0-rx-0-21swapper/323:26:253
29715040,0irq/26-eth0-rx-0-21swapper/323:11:243
29715040,0irq/26-eth0-rx-0-21swapper/322:26:413
29715040,0irq/26-eth0-rx-0-21swapper/321:56:523
29715040,0irq/26-eth0-rx-0-21swapper/321:31:423
29715040,0irq/26-eth0-rx-0-21swapper/320:56:273
29715040,0irq/26-eth0-rx-0-21swapper/319:06:323
259940,0migration/27990-21kthreadcore22:56:372
249940,0watchdog/28277-21unixbench_multi23:56:432
249940,0watchdog/20-21swapper/223:21:322
249940,0watchdog/20-21swapper/200:16:432
249940,0watchdog/20-21swapper/200:02:512
179940,0migration/1931-21timerwakeupswit22:31:431
179940,0migration/18558-21kthreadcore19:46:371
179940,0migration/16346-21kthreadcore20:06:391
179940,0migration/15530-21kthreadcore21:16:361
179940,0migration/14169-21kthreadcore23:36:371
179940,0migration/14102-21cpuspeed_turbos21:36:331
179940,0migration/13526-21latency_hist21:56:211
179940,0migration/127784-21kthreadcore19:36:361
179940,0migration/127538-21munin-node23:51:351
179940,0migration/127140-21cpuspeed_turbos20:01:341
179940,0migration/12623-21fschecks_count23:56:331
179940,0migration/124734-21timerandwakeup23:26:431
179940,0migration/123285-21kthreadcore19:56:391
179940,0migration/121714-21kthreadcore19:31:381
179940,0migration/120923-21kthreadcore23:06:371
179940,0migration/12079-21kthreadcore19:41:381
179940,0migration/116096-21kthreadcore21:21:391
179940,0migration/115743-21kthreadcore22:41:391
179940,0migration/114818-21irqstats19:51:391
179940,0migration/112796-21kthreadcore23:21:371
169940,0watchdog/19703-21ssh20:57:481
169940,0watchdog/111199-21chrt18:58:531
169940,0watchdog/10-21swapper/121:11:321
169940,0watchdog/10-21swapper/120:46:401
149940,0migration/09849-21kthreadcore19:46:380
149940,0migration/05575-21kthreadcore23:56:370
149940,0migration/012916-21kthreadcore23:21:370
8215030,0irq/24-0000:00:0-21swapper/220:36:222
47549932,0cyclictest3514-21snmpd20:51:382
47549932,0cyclictest2959-21awk20:31:362
47549932,0cyclictest28694-21awk20:26:362
47549932,0cyclictest1970-21awk20:06:362
47549932,0cyclictest13846-21tr19:51:352
47549932,0cyclictest12202-21kthreadcore20:11:392
47539932,0cyclictest8854-21awk20:11:371
47539932,0cyclictest10001-21irqrtprio20:36:381
47539930,0cyclictest29840-21iostat20:51:381
47539930,0cyclictest16513-21iostat20:41:371
47529933,0cyclictest21003-21kworker/0:021:21:250
47529933,0cyclictest21003-21kworker/0:021:01:230
47529933,0cyclictest21003-21kworker/0:020:26:230
47529933,0cyclictest12816-21kworker/0:223:46:290
47529933,0cyclictest12816-21kworker/0:223:36:230
47529933,0cyclictest12816-21kworker/0:223:16:230
47529933,0cyclictest12816-21kworker/0:223:11:230
47529933,0cyclictest12816-21kworker/0:222:41:230
47529933,0cyclictest12816-21kworker/0:200:16:250
47529933,0cyclictest12816-21kworker/0:200:06:230
47529933,0cyclictest12319-21kworker/0:219:51:240
47529933,0cyclictest12319-21kworker/0:219:31:340
29715030,0irq/26-eth0-rx-0-21swapper/320:29:243
29715030,0irq/26-eth0-rx-0-21swapper/320:21:373
29715030,0irq/26-eth0-rx-0-21swapper/320:18:353
29715030,0irq/26-eth0-rx-0-21swapper/320:01:343
29715030,0irq/26-eth0-rx-0-21swapper/319:57:103
29715030,0irq/26-eth0-rx-0-21swapper/319:53:523
29715030,0irq/26-eth0-rx-0-21swapper/319:46:333
29715030,0irq/26-eth0-rx-0-21swapper/319:41:333
29715030,0irq/26-eth0-rx-0-21swapper/319:36:063
29715030,0irq/26-eth0-rx-0-21swapper/319:21:333
29715030,0irq/26-eth0-rx-0-21swapper/319:11:463
29715030,0irq/26-eth0-rx-0-21swapper/319:02:093
259930,0migration/215570-21aten_r1power_en20:41:332
249930,0watchdog/26869-21munin-node19:46:322
249930,0watchdog/226897-21ps20:01:322
249930,0watchdog/223454-21kthreadcore20:46:402
169930,0watchdog/126828-21munin-node23:31:321
169930,0watchdog/10-21swapper/122:26:321
169930,0watchdog/10-21swapper/121:42:081
169930,0watchdog/10-21swapper/119:16:411
169930,0watchdog/10-21swapper/119:06:331
13008230,0sleep10-21swapper/119:26:361
339920,0migration/331990-21diskstats19:16:353
339920,0migration/33098-21iostat_ios20:31:373
339920,0migration/326896-21iostat_ios19:36:353
329920,0watchdog/313859-21unixbench_singl20:11:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional