You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 12:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Mon Aug 10, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200129178,0sleep00-21swapper/018:45:500
304450890,0irq/25-eth10-21swapper/318:46:103
209027473,0sleep20-21swapper/218:46:522
180023422,0sleep10-21swapper/118:43:271
35160,0ktimersoftd/30-21swapper/323:01:323
339960,0migration/37403-21sh20:49:553
339960,0migration/332278-21sh21:26:533
339960,0migration/330837-21sh21:43:523
339960,0migration/328996-21sh23:27:183
339960,0migration/322731-21sh22:00:163
339960,0migration/314946-21sh21:33:483
339960,0migration/313646-21munin-node23:37:343
339960,0migration/312521-21sh23:37:073
29725060,0irq/27-eth0-tx-22494-21munin-node19:02:390
29715060,0irq/26-eth0-rx-0-21swapper/322:34:453
22049965,0cyclictest25088-21ps23:02:341
22049965,0cyclictest0-21swapper/122:49:591
22049960,0cyclictest0-21swapper/122:21:461
22049960,0cyclictest0-21swapper/121:16:391
22039966,0cyclictest0-21swapper/022:07:310
22039960,0cyclictest0-21swapper/021:43:430
149960,0migration/03250-21sh23:49:530
149960,0migration/013108-21sh22:55:260
8215050,0irq/24-0000:00:30891-21perf19:57:192
339950,0migration/35473-21munin-node21:47:383
339950,0migration/34078-21cpuspeed_turbos00:12:323
339950,0migration/34078-21cpuspeed_turbos00:12:323
339950,0migration/33596-21unixbench_multi23:07:433
339950,0migration/331178-21kthreadcore23:47:343
339950,0migration/331136-21switchtime20:17:423
339950,0migration/327945-21kthreadcore22:02:363
339950,0migration/326750-21timerandwakeup23:42:463
339950,0migration/326404-21munin-node00:02:463
339950,0migration/32070-21kthreadcore20:22:363
339950,0migration/320213-21fschecks_count20:37:323
339950,0migration/319372-21taskset20:36:223
339950,0migration/31925-21sh00:07:453
339950,0migration/318840-21kthreadcore19:22:363
339950,0migration/316990-21kthreadcore23:57:343
339950,0migration/316892-21kthreadcore22:17:353
339950,0migration/314021-21taskset21:52:493
339950,0migration/312353-21taskset22:53:083
339950,0migration/310284-21kthreadcore22:12:353
29725050,0irq/27-eth0-tx-9966-21ssh00:12:522
29725050,0irq/27-eth0-tx-9966-21ssh00:12:522
29725050,0irq/27-eth0-tx-7347-21gltestperf22:32:332
29725050,0irq/27-eth0-tx-592-21munin-node21:07:442
29725050,0irq/27-eth0-tx-30440-21munin-node22:47:332
29725050,0irq/27-eth0-tx-30257-21grep21:22:392
29725050,0irq/27-eth0-tx-28743-21munin-node23:47:322
29725050,0irq/27-eth0-tx-27007-21ssh00:04:372
29725050,0irq/27-eth0-tx-24833-21kthreadcore22:22:352
29725050,0irq/27-eth0-tx-22041-21proc_pri21:37:422
29725050,0irq/27-eth0-tx-21332-21munin-node23:22:392
29725050,0irq/27-eth0-tx-0-21swapper/223:58:032
29725050,0irq/27-eth0-tx-0-21swapper/222:57:312
29725050,0irq/27-eth0-tx-0-21swapper/222:10:362
29725050,0irq/27-eth0-tx-0-21swapper/221:20:312
29725050,0irq/27-eth0-tx-0-21swapper/221:00:042
29725050,0irq/27-eth0-tx-0-21swapper/220:55:452
29725050,0irq/27-eth0-tx-0-21swapper/020:28:080
29725050,0irq/27-eth0-tx-0-21swapper/020:02:390
29725050,0irq/27-eth0-tx-0-21swapper/020:01:490
29725050,0irq/27-eth0-tx-0-21swapper/019:29:170
29715050,0irq/26-eth0-rx-9816-21missed_timers23:52:373
29715050,0irq/26-eth0-rx-6502-21munin-node21:07:433
29715050,0irq/26-eth0-rx-23676-21cut23:02:333
29715050,0irq/26-eth0-rx-21624-21kthreadcore19:47:413
29715050,0irq/26-eth0-rx-14818-21ssh20:53:043
29715050,0irq/26-eth0-rx-1184-21kthreadcore19:07:363
29715050,0irq/26-eth0-rx-0-21swapper/323:27:533
29715050,0irq/26-eth0-rx-0-21swapper/323:17:323
29715050,0irq/26-eth0-rx-0-21swapper/323:15:333
29715050,0irq/26-eth0-rx-0-21swapper/322:37:333
29715050,0irq/26-eth0-rx-0-21swapper/322:30:013
29715050,0irq/26-eth0-rx-0-21swapper/322:24:163
29715050,0irq/26-eth0-rx-0-21swapper/322:07:353
29715050,0irq/26-eth0-rx-0-21swapper/321:27:353
29715050,0irq/26-eth0-rx-0-21swapper/321:15:533
29715050,0irq/26-eth0-rx-0-21swapper/321:03:293
29715050,0irq/26-eth0-rx-0-21swapper/319:37:443
259950,0migration/29179-21switchtime19:12:432
259950,0migration/26861-21sh21:28:272
259950,0migration/23829-21sh23:08:072
259950,0migration/223369-21kthreadcore20:12:372
259950,0migration/223196-21gltestperf19:02:322
259950,0migration/214244-21idleruntime23:17:322
259950,0migration/211020-21latency_hist19:42:192
249950,0watchdog/228969-21grep22:02:372
249950,0watchdog/212959-21grep19:17:372
22059954,0cyclictest25368-21cut21:02:312
22049955,0cyclictest0-21swapper/121:53:421
22049955,0cyclictest0-21swapper/100:04:431
22049950,0cyclictest0-21swapper/123:40:541
22049950,0cyclictest0-21swapper/122:46:211
22039950,0cyclictest0-21swapper/022:51:590
22039950,0cyclictest0-21swapper/022:22:390
22039950,0cyclictest0-21swapper/020:56:060
22039950,0cyclictest0-21swapper/019:07:190
179950,0migration/125517-21timerwakeupswit20:37:421
169950,0watchdog/128122-21ssh23:24:401
149950,0migration/09898-21munin-node00:12:430
149950,0migration/09898-21munin-node00:12:430
149950,0migration/09310-21kthreadcore21:52:340
149950,0migration/08338-21kthreadcore23:32:350
149950,0migration/06987-21sh21:50:280
149950,0migration/06417-21munin-node20:47:430
149950,0migration/04880-21munin-node19:37:400
149950,0migration/03921-21kthreadcore18:47:350
149950,0migration/031686-21kthreadcore23:07:360
149950,0migration/030947-21munin-node20:17:400
149950,0migration/030895-21latency_hist22:27:180
149950,0migration/029662-21kthreadcore19:52:370
149950,0migration/025649-21sh21:02:320
149950,0migration/024939-21kthreadcore23:42:400
149950,0migration/024540-21kthreadcore22:42:350
149950,0migration/024471-21sh22:02:330
149950,0migration/023135-21irqrtprio23:02:330
149950,0migration/022191-21munin-node23:22:320
149950,0migration/022128-21missed_timers20:57:370
149950,0migration/021959-21kthreadcore20:12:370
149950,0migration/021671-21kthreadcore21:37:390
149950,0migration/021195-21sh22:39:110
149950,0migration/019826-21switchtime22:57:410
149950,0migration/019663-21kthreadcore18:57:370
149950,0migration/017934-21irqcore19:22:350
149950,0migration/016754-21kthreadcore22:17:350
149950,0migration/015577-21taskset21:35:440
149950,0migration/014525-21kthreadcore19:42:370
149950,0migration/013908-21fschecks_count23:17:310
149950,0migration/010897-21kthreadcore22:32:370
339940,0migration/329809-21kthreadcore20:42:353
339940,0migration/325551-21kthreadcore22:42:353
339940,0migration/313469-21kthreadcore18:52:383
29725040,0irq/27-eth0-tx-8858-21ssh21:12:272
29725040,0irq/27-eth0-tx-6467-21ssh22:52:322
29725040,0irq/27-eth0-tx-17837-21munin-node19:47:460
29725040,0irq/27-eth0-tx-0-21swapper/223:27:222
29725040,0irq/27-eth0-tx-0-21swapper/222:43:312
29725040,0irq/27-eth0-tx-0-21swapper/222:18:492
29725040,0irq/27-eth0-tx-0-21swapper/222:12:192
29725040,0irq/27-eth0-tx-0-21swapper/221:52:262
29725040,0irq/27-eth0-tx-0-21swapper/221:47:192
29725040,0irq/27-eth0-tx-0-21swapper/200:07:272
29725040,0irq/27-eth0-tx-0-21swapper/020:42:310
29725040,0irq/27-eth0-tx-0-21swapper/019:32:350
29725040,0irq/27-eth0-tx-0-21swapper/019:13:210
29725040,0irq/27-eth0-tx-0-21swapper/018:52:330
29715040,0irq/26-eth0-rx-0-21swapper/322:47:563
29715040,0irq/26-eth0-rx-0-21swapper/321:40:143
29715040,0irq/26-eth0-rx-0-21swapper/321:19:183
29715040,0irq/26-eth0-rx-0-21swapper/320:57:523
29715040,0irq/26-eth0-rx-0-21swapper/320:12:313
29715040,0irq/26-eth0-rx-0-21swapper/320:02:423
29715040,0irq/26-eth0-rx-0-21swapper/319:52:303
29715040,0irq/26-eth0-rx-0-21swapper/318:47:303
259940,0migration/25725-21munin-node23:32:322
259940,0migration/24741-21unixbench_singl22:27:412
259940,0migration/24358-21sh23:52:282
259940,0migration/225870-21kthreadcore23:02:342
259940,0migration/225633-21unixbench_multi20:37:422
259940,0migration/224193-21latency_hist21:42:182
259940,0migration/224073-21fschecks_time19:27:332
259940,0migration/219734-21kthreadcore22:37:352
259940,0migration/216205-21munin-node21:57:322
259940,0migration/214761-21kthreadcore20:32:382
249940,0watchdog/25366-21python20:22:412
249940,0watchdog/228427-21cut20:17:372
249940,0watchdog/220830-21ssh23:42:322
249940,0watchdog/211695-21fschecks_count19:42:332
22059944,0cyclictest0-21swapper/223:37:202
22059943,0cyclictest9373-21awk21:32:332
22059943,0cyclictest3556-21lldpd20:31:172
22059943,0cyclictest3556-21lldpd19:22:472
22059943,0cyclictest3556-21lldpd19:00:472
22059943,0cyclictest3514-21snmpd23:14:112
22059943,0cyclictest3514-21snmpd19:37:122
22059943,0cyclictest3514-21snmpd18:56:112
22059943,0cyclictest3296-21awk18:47:332
22059943,0cyclictest29962-21awk19:07:332
22059943,0cyclictest1533-21awk20:47:372
22049944,0cyclictest0-21swapper/122:11:401
22049944,0cyclictest0-21swapper/121:32:151
22049943,0cyclictest8108-21awk22:12:321
22049943,0cyclictest5218-21awk23:52:331
22049943,0cyclictest3556-21lldpd23:33:181
22049943,0cyclictest3556-21lldpd19:48:471
22049943,0cyclictest3514-21snmpd20:42:271
22049943,0cyclictest3514-21snmpd20:04:271
22049943,0cyclictest3514-21snmpd19:27:421
22049943,0cyclictest3241-21irqbalance23:12:561
22049943,0cyclictest3241-21irqbalance22:27:271
22049943,0cyclictest3241-21irqbalance21:47:271
22049943,0cyclictest3241-21irqbalance21:45:571
22049943,0cyclictest3241-21irqbalance21:38:071
22049943,0cyclictest3241-21irqbalance19:32:471
22049943,0cyclictest3241-21irqbalance19:18:071
22049943,0cyclictest30273-21awk23:27:341
22049943,0cyclictest17804-21awk19:22:341
22049943,0cyclictest17693-21awk21:17:341
22049943,0cyclictest16759-21awk21:57:341
22049943,0cyclictest1509-21awk20:47:371
22049942,0cyclictest3514-21snmpd20:59:121
22049940,0cyclictest0-21swapper/119:53:051
22049940,0cyclictest0-21swapper/119:09:541
22039944,0cyclictest0-21swapper/021:27:190
22039943,0cyclictest9804-21awk21:12:320
22039943,0cyclictest3556-21lldpd23:30:480
22039943,0cyclictest1629-21awk21:07:370
22039943,0cyclictest13796-21awk23:37:350
22039943,0cyclictest12088-21munin-node20:07:380
22039943,0cyclictest10959-21needreboot23:12:370
22039940,0cyclictest0-21swapper/020:37:300
179940,0migration/19507-21kthreadcore22:52:361
179940,0migration/19342-21if_eth121:32:321
179940,0migration/16645-21kthreadcore00:12:371
179940,0migration/16645-21kthreadcore00:12:371
179940,0migration/132234-21irqcore19:57:351
179940,0migration/130976-21kthreadcore00:07:351
179940,0migration/125819-21fschecks_count20:17:331
179940,0migration/115918-21kthreadcore20:32:381
179940,0migration/115510-21kthreadcore20:07:361
169940,0watchdog/15310-21if_err_eth019:37:411
169940,0watchdog/1304-21diskmemload22:37:401
169940,0watchdog/129307-21ssh22:23:011
169940,0watchdog/122224-21ksmtuned19:01:571
169940,0watchdog/114199-21ssh22:37:001
169940,0watchdog/10-21swapper/123:42:401
169940,0watchdog/10-21swapper/123:07:361
169940,0watchdog/10-21swapper/121:22:211
169940,0watchdog/10-21swapper/121:07:331
169940,0watchdog/10-21swapper/120:12:371
169940,0watchdog/10-21swapper/119:12:371
169940,0watchdog/10-21swapper/118:52:371
149940,0migration/09260-21kthreadcore23:52:370
149940,0migration/08005-21sh22:12:310
149940,0migration/031580-21runrttasks21:24:440
149940,0migration/017602-21kthreadcore20:32:390
149940,0migration/013602-21kthreadcore19:17:370
339930,0migration/39503-21runrttasks19:12:533
339930,0migration/321877-21taskset18:57:553
29715030,0irq/26-eth0-rx-0-21swapper/320:27:283
29715030,0irq/26-eth0-rx-0-21swapper/320:10:023
29715030,0irq/26-eth0-rx-0-21swapper/319:59:083
29715030,0irq/26-eth0-rx-0-21swapper/319:42:313
29715030,0irq/26-eth0-rx-0-21swapper/319:32:403
29715030,0irq/26-eth0-rx-0-21swapper/319:19:283
249930,0watchdog/211102-21smartctl20:02:412
249930,0watchdog/20-21swapper/220:07:332
249930,0watchdog/20-21swapper/219:47:412
22059933,0cyclictest3556-21lldpd20:00:172
22059932,0cyclictest3514-21snmpd20:46:122
22049932,0cyclictest3236-21cut18:47:331
22049932,0cyclictest26842-21kthreadcore22:02:361
22049932,0cyclictest25500-21grep19:02:361
22049932,0cyclictest24918-21basename21:02:291
22049932,0cyclictest1638-21grep20:22:361
22049932,0cyclictest14873-21awk22:57:331
22049932,0cyclictest12855-21grep23:57:301
22039933,0cyclictest7427-21kworker/0:000:07:190
22039933,0cyclictest7427-21kworker/0:000:02:190
22039933,0cyclictest4855-21kworker/0:121:57:200
22039933,0cyclictest4855-21kworker/0:121:17:220
22039933,0cyclictest4855-21kworker/0:120:22:260
22039932,0cyclictest17901-21grep23:57:370
19130,0ktimersoftd/10-21swapper/120:28:241
179930,0migration/1646-21kthreadcore23:47:351
179930,0migration/110447-21kthreadcore20:52:371
169930,0watchdog/10-21swapper/123:17:281
169930,0watchdog/10-21swapper/119:42:331
29715020,0irq/26-eth0-rx-0-21swapper/319:27:313
29715020,0irq/26-eth0-rx-0-21swapper/319:02:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional