You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 16:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 02, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450520,0irq/25-eth10-21swapper/306:45:043
2640423727,0sleep20-21swapper/206:43:312
2648323324,0sleep10-21swapper/106:44:261
2646723322,0sleep00-21swapper/006:44:130
339960,0migration/329742-21kthreadcore06:48:203
339960,0migration/325238-21irqrtprio09:48:173
339960,0migration/319036-21sh12:06:293
29725060,0irq/27-eth0-tx-28031-21munin-node07:13:180
29725060,0irq/27-eth0-tx-0-21swapper/210:49:442
29715060,0irq/26-eth0-rx-0-21swapper/311:22:133
268669960,0cyclictest30559-21tune2fs08:03:160
149960,0migration/032401-21sh09:11:490
149960,0migration/03108-21sh11:34:430
149960,0migration/018063-21ntp_offset11:43:200
339950,0migration/38682-21crond08:58:023
339950,0migration/36962-21diskmemload09:13:353
339950,0migration/3405-21kthreadcore10:53:193
339950,0migration/33345-21kthreadcore09:33:213
339950,0migration/330961-21kthreadcore11:13:193
339950,0migration/330273-21proc_pri09:28:263
339950,0migration/329943-21latency_hist08:03:023
339950,0migration/329138-21diskmemload11:12:423
339950,0migration/328417-21taskset11:32:183
339950,0migration/323313-21kthreadcore12:08:193
339950,0migration/322208-21munin-node10:48:123
339950,0migration/322097-21kthreadcore11:48:193
339950,0migration/321858-21kthreadcore08:18:193
339950,0migration/321799-21diskmemload10:47:403
339950,0migration/320689-21kthreadcore08:43:193
339950,0migration/320570-21kthreadcore09:23:203
339950,0migration/317036-21kthreadcore08:38:193
339950,0migration/314652-21latency_hist10:23:023
339950,0migration/313546-21irqcore11:43:173
339950,0migration/313376-21cpuspeed_turbos11:23:133
29725050,0irq/27-eth0-tx-27080-21munin-node06:48:230
29725050,0irq/27-eth0-tx-26267-21ssh08:48:190
29725050,0irq/27-eth0-tx-0-21swapper/007:43:200
29725050,0irq/27-eth0-tx-0-21swapper/007:28:160
29715050,0irq/26-eth0-rx-9317-21df_abs08:58:153
29715050,0irq/26-eth0-rx-8676-21grep06:58:163
29715050,0irq/26-eth0-rx-4925-21diskstats11:38:153
29715050,0irq/26-eth0-rx-29998-21iostat_ios07:38:203
29715050,0irq/26-eth0-rx-24608-21irqcore10:08:173
29715050,0irq/26-eth0-rx-24608-21irqcore10:08:173
29715050,0irq/26-eth0-rx-0-21swapper/312:15:123
29715050,0irq/26-eth0-rx-0-21swapper/312:01:393
29715050,0irq/26-eth0-rx-0-21swapper/310:41:253
29715050,0irq/26-eth0-rx-0-21swapper/310:37:233
29715050,0irq/26-eth0-rx-0-21swapper/310:28:083
29715050,0irq/26-eth0-rx-0-21swapper/310:23:183
29715050,0irq/26-eth0-rx-0-21swapper/310:03:203
29715050,0irq/26-eth0-rx-0-21swapper/309:53:143
29715050,0irq/26-eth0-rx-0-21swapper/309:45:283
29715050,0irq/26-eth0-rx-0-21swapper/309:38:193
29715050,0irq/26-eth0-rx-0-21swapper/309:18:553
29715050,0irq/26-eth0-rx-0-21swapper/307:58:023
27150,0ktimersoftd/20-21swapper/210:01:292
268689955,0cyclictest0-21swapper/212:03:212
268689955,0cyclictest0-21swapper/212:00:122
268689955,0cyclictest0-21swapper/209:35:002
268689955,0cyclictest0-21swapper/209:30:442
268689954,0cyclictest7719-21grep10:18:142
268679955,0cyclictest0-21swapper/110:30:411
268679955,0cyclictest0-21swapper/109:06:201
268679950,0cyclictest0-21swapper/110:49:551
259950,0migration/227978-21cpu12:13:112
249950,0watchdog/224659-21kthreadcore10:28:192
249950,0watchdog/211533-21fschecks_time08:13:162
19150,0ktimersoftd/10-21swapper/110:47:241
179950,0migration/14791-21turbostat11:18:001
179950,0migration/13645-21kthreadcore10:33:191
179950,0migration/131220-21latency_hist10:13:021
179950,0migration/131220-21latency_hist10:13:021
179950,0migration/130631-21kthreadcore12:13:161
179950,0migration/12995-21kthreadcore10:13:191
179950,0migration/12545-21cpuspeed_turbos07:18:121
179950,0migration/11321-21switchtime07:13:251
179950,0migration/110982-21if_eth1.307:48:161
169950,0watchdog/17954-21kthreadcore11:38:191
169950,0watchdog/120884-21ssh11:06:431
149950,0migration/0921-21kthreadcore11:13:190
149950,0migration/07692-21kthreadcore08:08:200
149950,0migration/04747-21sh10:55:560
149950,0migration/04473-21unixbench-2d08:28:250
149950,0migration/03479-21kthreadcore09:53:190
149950,0migration/03314-21irqcore07:18:160
149950,0migration/032142-21kthreadcore10:33:180
149950,0migration/029761-21munin-node07:38:180
149950,0migration/025794-21kthreadcore10:08:180
149950,0migration/025794-21kthreadcore10:08:180
149950,0migration/025404-21kthreadcore11:48:200
149950,0migration/024707-21kthreadcore12:08:190
149950,0migration/024046-21kthreadcore11:28:210
149950,0migration/022722-21kthreadcore08:43:200
149950,0migration/022521-21munin-node09:23:250
149950,0migration/022454-21munin-node10:48:140
149950,0migration/02120-21kthreadcore09:13:180
149950,0migration/019355-21kthreadcore07:03:190
149950,0migration/01902-21kthreadcore10:13:190
149950,0migration/017426-21kthreadcore10:23:180
149950,0migration/01411-21munin-node09:33:200
149950,0migration/014091-21kthreadcore08:13:200
149950,0migration/013050-21irqcore08:38:180
149950,0migration/010971-21switchtime11:18:260
149950,0migration/010850-21sh11:38:490
149950,0migration/010801-21kthreadcore10:58:190
149950,0migration/010499-21taskset11:59:260
8215040,0irq/24-0000:00:0-21swapper/210:58:182
8215040,0irq/24-0000:00:0-21swapper/206:53:022
339940,0migration/37730-21kthreadcore08:08:203
339940,0migration/34163-21kthreadcore06:53:203
339940,0migration/331288-21kthreadcore11:33:183
339940,0migration/322902-21fschecks_time07:33:183
339940,0migration/311039-21kthreadcore07:23:193
29725040,0irq/27-eth0-tx-8975-21munin-node08:58:152
29725040,0irq/27-eth0-tx-662-21munin-node08:53:122
29725040,0irq/27-eth0-tx-30698-21ssh10:33:072
29725040,0irq/27-eth0-tx-30022-21ssh10:09:402
29725040,0irq/27-eth0-tx-30022-21ssh10:09:402
29725040,0irq/27-eth0-tx-0-21swapper/212:08:212
29725040,0irq/27-eth0-tx-0-21swapper/211:49:112
29725040,0irq/27-eth0-tx-0-21swapper/211:37:572
29725040,0irq/27-eth0-tx-0-21swapper/211:28:252
29725040,0irq/27-eth0-tx-0-21swapper/211:23:202
29725040,0irq/27-eth0-tx-0-21swapper/209:43:052
29725040,0irq/27-eth0-tx-0-21swapper/209:08:112
29725040,0irq/27-eth0-tx-0-21swapper/007:48:120
29725040,0irq/27-eth0-tx-0-21swapper/007:35:110
29725040,0irq/27-eth0-tx-0-21swapper/007:08:120
29725040,0irq/27-eth0-tx-0-21swapper/006:58:150
29715040,0irq/26-eth0-rx-0-21swapper/311:53:163
29715040,0irq/26-eth0-rx-0-21swapper/311:05:323
29715040,0irq/26-eth0-rx-0-21swapper/310:58:273
29715040,0irq/26-eth0-rx-0-21swapper/310:15:403
29715040,0irq/26-eth0-rx-0-21swapper/309:58:363
29715040,0irq/26-eth0-rx-0-21swapper/309:08:203
29715040,0irq/26-eth0-rx-0-21swapper/309:05:193
29715040,0irq/26-eth0-rx-0-21swapper/308:48:143
29715040,0irq/26-eth0-rx-0-21swapper/308:33:213
29715040,0irq/26-eth0-rx-0-21swapper/307:53:233
268689944,0cyclictest0-21swapper/208:48:292
268689944,0cyclictest0-21swapper/208:18:132
268689943,0cyclictest8957-21awk06:58:182
268689943,0cyclictest5672-21sort08:33:172
268689943,0cyclictest3514-21snmpd08:46:372
268689943,0cyclictest3514-21snmpd07:53:362
268689943,0cyclictest3514-21snmpd07:51:362
268689943,0cyclictest3514-21snmpd07:38:512
268689943,0cyclictest3514-21snmpd07:08:062
268689943,0cyclictest3241-21irqbalance09:55:202
268689943,0cyclictest3241-21irqbalance09:13:102
268689943,0cyclictest3241-21irqbalance08:38:202
268689943,0cyclictest3241-21irqbalance08:28:102
268689943,0cyclictest3241-21irqbalance08:23:502
268689943,0cyclictest30825-21awk08:03:172
268689943,0cyclictest24213-21awk07:58:192
268689943,0cyclictest22586-21awk11:08:162
268689943,0cyclictest2015-21sadc07:18:022
268689943,0cyclictest17861-21awk09:03:162
268689943,0cyclictest17559-21awk09:23:172
268679944,0cyclictest0-21swapper/110:38:531
268679943,0cyclictest9857-21awk08:58:181
268679943,0cyclictest9574-21awk09:18:161
268679943,0cyclictest9465-21wc11:58:201
268679943,0cyclictest7925-21awk10:18:161
268679943,0cyclictest6599-21awk10:58:161
268679943,0cyclictest3556-21lldpd09:13:441
268679943,0cyclictest3556-21lldpd08:43:131
268679943,0cyclictest3556-21lldpd08:24:141
268679943,0cyclictest3514-21snmpd12:04:081
268679943,0cyclictest3514-21snmpd11:54:381
268679943,0cyclictest3514-21snmpd10:54:521
268679943,0cyclictest3514-21snmpd09:45:371
268679943,0cyclictest3514-21snmpd09:25:371
268679943,0cyclictest3514-21snmpd08:57:371
268679943,0cyclictest3514-21snmpd08:18:521
268679943,0cyclictest3514-21snmpd07:55:371
268679943,0cyclictest3514-21snmpd07:44:511
268679943,0cyclictest3514-21snmpd07:33:061
268679943,0cyclictest3514-21snmpd07:29:361
268679943,0cyclictest3241-21irqbalance07:11:501
268679943,0cyclictest29878-21awk07:38:191
268679943,0cyclictest27962-21awk06:48:181
268679943,0cyclictest26227-21awk08:48:181
268679943,0cyclictest25016-21awk09:48:161
268679943,0cyclictest24310-21awk07:58:191
268679943,0cyclictest21387-21awk11:48:171
268679943,0cyclictest20714-21awk12:08:161
268679943,0cyclictest15842-21awk10:23:161
268679940,0cyclictest0-21swapper/109:38:051
268669943,0cyclictest3556-21lldpd09:43:430
268669943,0cyclictest3241-21irqbalance12:03:390
268669943,0cyclictest3241-21irqbalance10:01:200
268669943,0cyclictest3241-21irqbalance09:06:500
268669943,0cyclictest29367-21awk11:53:170
268669943,0cyclictest19300-21sed11:03:220
259940,0migration/230762-21fschecks_time10:53:162
259940,0migration/225933-21kthreadcore09:48:182
259940,0migration/225822-21kthreadcore07:33:232
249940,0watchdog/28466-21tr10:38:192
249940,0watchdog/25046-21ssh11:18:072
249940,0watchdog/228841-21df_inode11:53:152
249940,0watchdog/216254-21gltestperf10:03:152
249940,0watchdog/215064-21cut10:43:152
249940,0watchdog/214718-21sh09:39:362
249940,0watchdog/213324-21idleruntime11:43:152
249940,0watchdog/210178-21open_inodes11:38:232
249940,0watchdog/20-21swapper/211:13:192
249940,0watchdog/20-21swapper/211:03:232
249940,0watchdog/20-21swapper/210:15:552
249940,0watchdog/20-21swapper/208:08:202
179940,0migration/19951-21rt-features08:08:241
179940,0migration/19795-21hddtemp_smartct07:23:161
179940,0migration/19214-21kthreadcore11:18:211
179940,0migration/14044-21turbostat.cron08:07:571
179940,0migration/13668-21kthreadcore09:33:211
179940,0migration/131295-21df_abs08:28:141
179940,0migration/118614-21sh11:23:201
179940,0migration/114272-21kthreadcore11:43:171
179940,0migration/112730-21kthreadcore09:58:201
179940,0migration/112171-21cpuspeed_turbos08:38:141
169940,0watchdog/15490-21cat08:33:161
169940,0watchdog/14478-21kthreadcore06:53:201
169940,0watchdog/128089-21ssh11:31:191
169940,0watchdog/125454-21ssh09:28:201
169940,0watchdog/11652-21kthreadcore11:33:191
169940,0watchdog/116266-21gltestperf10:03:151
169940,0watchdog/111535-21fschecks_time08:13:161
169940,0watchdog/10-21swapper/109:53:161
169940,0watchdog/10-21swapper/109:08:201
149940,0migration/08108-40yum-updatesd09:38:030
149940,0migration/029492-21kthreadcore09:28:230
149940,0migration/026030-21kthreadcore09:48:180
149940,0migration/024195-21kthreadcore10:28:190
149940,0migration/021120-21kthreadcore07:53:190
149940,0migration/020239-21timerwakeupswit10:43:250
149940,0migration/018093-21kthreadcore10:03:190
149940,0migration/013170-21runrttasks10:40:360
149940,0migration/011855-21kthreadcore07:23:190
339930,0migration/324355-21munin-node08:23:113
29725030,0irq/27-eth0-tx-0-21swapper/210:23:112
29715030,0irq/26-eth0-rx-0-21swapper/308:28:133
29715030,0irq/26-eth0-rx-0-21swapper/308:13:133
29715030,0irq/26-eth0-rx-0-21swapper/307:48:133
29715030,0irq/26-eth0-rx-0-21swapper/307:44:353
29715030,0irq/26-eth0-rx-0-21swapper/307:30:183
29715030,0irq/26-eth0-rx-0-21swapper/307:18:123
29715030,0irq/26-eth0-rx-0-21swapper/307:13:393
29715030,0irq/26-eth0-rx-0-21swapper/307:08:133
29715030,0irq/26-eth0-rx-0-21swapper/307:05:133
268689932,0cyclictest4321-21awk07:43:222
268689932,0cyclictest3514-21snmpd07:03:062
268689932,0cyclictest3118-21awk07:18:142
268689932,0cyclictest2322-21awk06:53:182
268689932,0cyclictest10678-21cut07:23:192
268689930,0cyclictest16317-21perl07:28:172
268679932,0cyclictest8911-21awk06:58:181
268679932,0cyclictest3241-21irqbalance07:03:201
268679932,0cyclictest27397-21cat11:08:231
268669933,0cyclictest30419-21kworker/0:211:26:120
268669933,0cyclictest30419-21kworker/0:211:08:160
268669933,0cyclictest1254-21kworker/0:109:18:170
268669933,0cyclictest1254-21kworker/0:108:58:210
268669933,0cyclictest1254-21kworker/0:108:23:050
268669933,0cyclictest1254-21kworker/0:108:18:130
268669933,0cyclictest1254-21kworker/0:106:54:030
268669932,0cyclictest6121-21awk08:33:180
268669932,0cyclictest3514-21snmpd07:58:070
268669932,0cyclictest27756-21munin-node12:13:110
268669932,0cyclictest1659-21awk08:53:150
268669930,0cyclictest10947-21cut10:18:180
259930,0migration/211026-21kthreadcore09:18:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional