You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 17:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Dec 09, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1062726766,0sleep20-21swapper/206:35:072
1067726564,0sleep10-21swapper/106:35:381
291350350,0irq/25-eth10-21swapper/306:34:583
1069123430,0sleep00-21swapper/006:35:490
11032991616,0cyclictest18089-21sensors10:24:230
28415070,0irq/27-eth0-tx-0-21swapper/007:31:110
35160,0ktimersoftd/30-21swapper/311:44:313
339960,0migration/34437-21munin-node09:34:223
339960,0migration/332391-21sh11:59:373
339960,0migration/327225-21sh10:09:423
339960,0migration/321459-21kthreadcore10:49:183
339960,0migration/321226-21sh09:46:553
339960,0migration/320083-21sh10:07:063
339960,0migration/319076-21sh10:26:223
339960,0migration/315834-21munin-node08:39:243
339960,0migration/313662-21sh09:19:213
339960,0migration/311924-21missed_timers07:24:183
28415060,0irq/27-eth0-tx-8522-21perl09:19:122
28415060,0irq/27-eth0-tx-5571-21munin-node06:59:120
28415060,0irq/27-eth0-tx-0-21swapper/212:06:362
28415060,0irq/27-eth0-tx-0-21swapper/211:42:592
28415060,0irq/27-eth0-tx-0-21swapper/211:31:382
28415060,0irq/27-eth0-tx-0-21swapper/211:28:532
28415060,0irq/27-eth0-tx-0-21swapper/211:16:102
28415060,0irq/27-eth0-tx-0-21swapper/210:59:062
28415060,0irq/27-eth0-tx-0-21swapper/210:44:102
28415060,0irq/27-eth0-tx-0-21swapper/210:29:462
28415060,0irq/27-eth0-tx-0-21swapper/210:22:112
28415060,0irq/27-eth0-tx-0-21swapper/210:13:582
28415060,0irq/27-eth0-tx-0-21swapper/210:01:352
28415060,0irq/27-eth0-tx-0-21swapper/209:48:462
28415060,0irq/27-eth0-tx-0-21swapper/209:39:322
28415060,0irq/27-eth0-tx-0-21swapper/209:31:292
28415060,0irq/27-eth0-tx-0-21swapper/209:08:442
28415060,0irq/27-eth0-tx-0-21swapper/209:02:162
28415060,0irq/27-eth0-tx-0-21swapper/208:51:202
249960,0watchdog/28270-21ssh08:58:132
179960,0migration/16296-21needreboot07:44:191
149960,0migration/05958-21fschecks_time09:59:120
149960,0migration/025756-21munin-node10:29:190
149960,0migration/02177-21sh11:43:480
149960,0migration/020931-21sh09:45:430
149960,0migration/015768-21sh09:02:060
149960,0migration/013332-21cpu10:04:120
110339960,0cyclictest0-21swapper/111:39:261
110329960,0cyclictest0-21swapper/010:50:130
110329960,0cyclictest0-21swapper/010:36:020
8225050,0irq/24-0000:00:31995-21latency_hist07:18:592
339950,0migration/36361-21latency_hist09:38:593
339950,0migration/3574-21kthreadcore10:14:183
339950,0migration/33245-21kthreadcore06:54:203
339950,0migration/328513-21latency_hist08:28:593
339950,0migration/319607-21cpuspeed_turbos11:34:093
339950,0migration/316655-21munin-node11:04:213
339950,0migration/316558-21runrttasks08:19:163
339950,0migration/316460-21kthreadcore06:39:173
339950,0migration/310024-21kthreadcore07:49:183
28415050,0irq/27-eth0-tx-27675-21ssh10:11:172
28415050,0irq/27-eth0-tx-18416-21munin-node11:09:152
28415050,0irq/27-eth0-tx-17949-21munin-node06:44:120
28415050,0irq/27-eth0-tx-12266-21munin-node07:04:200
28415050,0irq/27-eth0-tx-0-21swapper/211:52:162
28415050,0irq/27-eth0-tx-0-21swapper/211:46:142
28415050,0irq/27-eth0-tx-0-21swapper/211:22:322
28415050,0irq/27-eth0-tx-0-21swapper/211:08:182
28415050,0irq/27-eth0-tx-0-21swapper/210:36:322
28415050,0irq/27-eth0-tx-0-21swapper/210:28:432
28415050,0irq/27-eth0-tx-0-21swapper/210:08:452
28415050,0irq/27-eth0-tx-0-21swapper/209:56:562
28415050,0irq/27-eth0-tx-0-21swapper/209:24:292
28415050,0irq/27-eth0-tx-0-21swapper/209:24:292
28415050,0irq/27-eth0-tx-0-21swapper/209:10:462
28415050,0irq/27-eth0-tx-0-21swapper/208:44:392
28415050,0irq/27-eth0-tx-0-21swapper/208:40:572
28415050,0irq/27-eth0-tx-0-21swapper/006:39:120
28405050,0irq/26-eth0-rx-5715-21kthreadcore08:54:173
28405050,0irq/26-eth0-rx-28567-21forks10:34:123
28405050,0irq/26-eth0-rx-27949-21fschecks_time10:54:143
28405050,0irq/26-eth0-rx-27719-21ssh11:39:183
28405050,0irq/26-eth0-rx-23661-21sh09:07:083
28405050,0irq/26-eth0-rx-11539-21munin-node11:29:143
28405050,0irq/26-eth0-rx-0-21swapper/312:04:543
28405050,0irq/26-eth0-rx-0-21swapper/311:49:153
28405050,0irq/26-eth0-rx-0-21swapper/311:19:183
28405050,0irq/26-eth0-rx-0-21swapper/311:10:423
28405050,0irq/26-eth0-rx-0-21swapper/310:59:123
28405050,0irq/26-eth0-rx-0-21swapper/310:44:153
28405050,0irq/26-eth0-rx-0-21swapper/310:39:553
28405050,0irq/26-eth0-rx-0-21swapper/310:19:093
28405050,0irq/26-eth0-rx-0-21swapper/310:03:033
28405050,0irq/26-eth0-rx-0-21swapper/309:33:183
28405050,0irq/26-eth0-rx-0-21swapper/309:24:163
28405050,0irq/26-eth0-rx-0-21swapper/309:24:163
28405050,0irq/26-eth0-rx-0-21swapper/308:04:153
28405050,0irq/26-eth0-rx-0-21swapper/307:19:133
259950,0migration/24390-21pmu-power09:34:212
259950,0migration/22422-21kthreadcore09:14:192
259950,0migration/221837-21kthreadcore06:44:162
259950,0migration/218450-21aten_r1power_po11:54:112
259950,0migration/214750-21fschecks_count07:54:102
259950,0migration/210006-21kthreadcore07:49:182
249950,0watchdog/20-21swapper/210:49:572
179950,0migration/19337-21rt-features11:24:201
179950,0migration/16594-21kthreadcore10:39:151
169950,0watchdog/117558-21munin-node08:44:171
169950,0watchdog/10-21swapper/111:23:171
169950,0watchdog/10-21swapper/110:50:091
169950,0watchdog/10-21swapper/110:15:411
169950,0watchdog/10-21swapper/108:24:171
149950,0migration/08126-21taskset08:11:010
149950,0migration/07583-21irqcore07:24:150
149950,0migration/0352-21taskset07:41:390
149950,0migration/031795-21pmu-power11:59:220
149950,0migration/029213-21sh09:52:260
149950,0migration/028481-21kthreadcore09:29:170
149950,0migration/02777-21kthreadcore07:44:170
149950,0migration/024714-21kthreadcore08:24:190
149950,0migration/023102-21kthreadcore11:09:180
149950,0migration/022237-21ntp_offset09:04:210
149950,0migration/020653-21kthreadcore08:44:170
149950,0migration/01871-21missed_timers10:14:190
149950,0migration/014933-21taskset08:17:420
149950,0migration/014710-21munin-node07:54:100
149950,0migration/014133-21taskset09:19:470
110349955,0cyclictest0-21swapper/211:36:512
110349955,0cyclictest0-21swapper/210:55:332
110349950,0cyclictest0-21swapper/207:44:002
110339955,0cyclictest9439-21diskmemload10:13:401
110339955,0cyclictest0-21swapper/111:11:421
110339955,0cyclictest0-21swapper/110:24:431
110339955,0cyclictest0-21swapper/109:44:491
110339950,0cyclictest0-21swapper/111:14:031
110339950,0cyclictest0-21swapper/111:00:301
110339950,0cyclictest0-21swapper/110:34:101
110339950,0cyclictest0-21swapper/108:49:011
110329955,0cyclictest0-21swapper/009:26:110
110329955,0cyclictest0-21swapper/009:26:110
110329950,0cyclictest0-21swapper/011:27:450
110329950,0cyclictest0-21swapper/010:47:510
110329950,0cyclictest0-21swapper/010:21:320
339940,0migration/37471-21kthreadcore11:24:163
339940,0migration/329968-21sh09:09:203
339940,0migration/327152-21diskmemload11:17:313
339940,0migration/325727-21irqcore06:49:153
339940,0migration/322351-21kthreadcore07:09:183
339940,0migration/316829-21kthreadcore07:54:143
339940,0migration/311838-21taskset07:01:513
28415040,0irq/27-eth0-tx-0-21swapper/211:59:132
28415040,0irq/27-eth0-tx-0-21swapper/210:39:332
28415040,0irq/27-eth0-tx-0-21swapper/008:31:220
28405040,0irq/26-eth0-rx-0-21swapper/311:54:453
28405040,0irq/26-eth0-rx-0-21swapper/310:30:003
28405040,0irq/26-eth0-rx-0-21swapper/309:57:293
28405040,0irq/26-eth0-rx-0-21swapper/309:14:353
28405040,0irq/26-eth0-rx-0-21swapper/308:59:463
28405040,0irq/26-eth0-rx-0-21swapper/308:49:573
28405040,0irq/26-eth0-rx-0-21swapper/308:45:583
28405040,0irq/26-eth0-rx-0-21swapper/307:59:093
259940,0migration/24947-21kthreadcore08:34:222
259940,0migration/24763-21timerwakeupswit06:54:252
259940,0migration/226877-21kthreadcore08:24:202
259940,0migration/224934-21kthreadcore09:49:162
259940,0migration/223257-21kthreadcore07:09:182
259940,0migration/216093-21kthreadcore07:04:182
259940,0migration/214792-21kthreadcore07:29:172
259940,0migration/212642-21kthreadcore06:39:162
249940,0watchdog/27781-21timerwakeupswit08:09:212
249940,0watchdog/223119-21kthreadcore07:59:172
249940,0watchdog/20-21swapper/208:14:172
179940,0migration/17892-21kthreadcore09:59:161
179940,0migration/130306-21kthreadcore07:14:171
179940,0migration/130197-21pmu-power09:09:221
179940,0migration/12647-21hwlatdetect08:09:131
179940,0migration/125295-21taskset11:57:021
179940,0migration/124266-21needreboot07:09:191
179940,0migration/11740-21kthreadcore06:54:191
179940,0migration/114386-21irqcore07:29:171
169940,0watchdog/131303-21cpuspeed_turbos09:34:131
169940,0watchdog/123121-21kthreadcore07:59:171
169940,0watchdog/10-21swapper/111:49:131
169940,0watchdog/10-21swapper/111:29:091
169940,0watchdog/10-21swapper/110:55:251
169940,0watchdog/10-21swapper/110:45:051
169940,0watchdog/10-21swapper/110:29:171
169940,0watchdog/10-21swapper/110:04:171
169940,0watchdog/10-21swapper/109:49:051
169940,0watchdog/10-21swapper/109:14:171
169940,0watchdog/10-21swapper/108:14:171
169940,0watchdog/10-21swapper/107:39:131
169940,0watchdog/10-21swapper/107:36:571
149940,0migration/09696-21aten_r1power_cu08:39:100
149940,0migration/027981-21kthreadcore08:49:220
149940,0migration/026378-21runrttasks11:14:290
149940,0migration/01588-21runrttasks08:08:500
149940,0migration/010784-21aten_r1power_vo11:04:100
110349943,0cyclictest6445-21snmpd08:20:372
110349943,0cyclictest6445-21snmpd08:08:372
110349943,0cyclictest6445-21snmpd07:37:372
110349943,0cyclictest6445-21snmpd07:25:072
110349943,0cyclictest6445-21snmpd07:22:372
110349943,0cyclictest6445-21snmpd06:52:072
110349943,0cyclictest27569-21awk07:39:152
110339944,0cyclictest21623-21kworker/1:210:19:141
110339944,0cyclictest0-21swapper/109:39:471
110339943,0cyclictest9694-21awk08:59:161
110339943,0cyclictest8723-21awk09:19:131
110339943,0cyclictest7412-21awk07:24:141
110339943,0cyclictest6445-21snmpd12:05:071
110339943,0cyclictest6445-21snmpd11:35:221
110339943,0cyclictest6445-21snmpd08:43:221
110339943,0cyclictest6445-21snmpd07:08:521
110339943,0cyclictest6445-21snmpd06:51:521
110339943,0cyclictest632-21awk07:19:121
110339943,0cyclictest3116-21kworker/1:006:59:111
110339943,0cyclictest30998-21awk09:54:161
110339943,0cyclictest29431-21awk08:29:131
110339943,0cyclictest26324-21kworker/1:109:24:141
110339943,0cyclictest26324-21kworker/1:109:24:141
110339943,0cyclictest24140-21awk09:29:141
110339943,0cyclictest21623-21kworker/1:211:44:041
110339943,0cyclictest21623-21kworker/1:211:06:401
110339943,0cyclictest17530-21awk09:04:161
110329944,0cyclictest0-21swapper/009:36:360
110329944,0cyclictest0-21swapper/009:09:100
110329943,0cyclictest6445-21snmpd06:56:520
110329943,0cyclictest3755-21awk10:59:140
110329943,0cyclictest3425-21lldpd12:04:040
110329943,0cyclictest28835-21awk11:19:150
110329943,0cyclictest26432-21awk07:14:140
110329943,0cyclictest20229-21awk11:34:120
28405030,0irq/26-eth0-rx-0-21swapper/309:49:003
28405030,0irq/26-eth0-rx-0-21swapper/308:26:503
28405030,0irq/26-eth0-rx-0-21swapper/308:14:423
28405030,0irq/26-eth0-rx-0-21swapper/308:09:123
28405030,0irq/26-eth0-rx-0-21swapper/307:44:123
28405030,0irq/26-eth0-rx-0-21swapper/307:40:343
28405030,0irq/26-eth0-rx-0-21swapper/307:34:123
28405030,0irq/26-eth0-rx-0-21swapper/307:29:123
28405030,0irq/26-eth0-rx-0-21swapper/307:04:113
28405030,0irq/26-eth0-rx-0-21swapper/306:48:273
110349932,0cyclictest5619-21cut06:59:092
110349930,0cyclictest28901-21df08:29:102
110339933,0cyclictest3116-21kworker/1:006:44:031
110339933,0cyclictest3116-21kworker/1:006:39:051
110339933,0cyclictest26324-21kworker/1:108:34:081
110339933,0cyclictest26324-21kworker/1:108:04:061
110339933,0cyclictest26324-21kworker/1:107:49:041
110339932,0cyclictest27098-21awk11:59:181
110339932,0cyclictest15200-21awk07:54:121
110339932,0cyclictest1117-21tr08:54:121
110339930,0cyclictest15987-21perl08:19:131
110329932,0cyclictest894-21awk09:14:170
110329932,0cyclictest6445-21snmpd11:29:070
110329932,0cyclictest5053-21ls09:58:590
110329932,0cyclictest5012-21kthreadcore10:39:150
110329932,0cyclictest27167-21cat10:53:580
110329932,0cyclictest21709-21grep10:09:120
110329932,0cyclictest20796-21awk07:34:140
110329932,0cyclictest1703-21awk08:54:140
110329932,0cyclictest16127-21awk08:19:140
110329932,0cyclictest10438-21munin-node11:49:110
110329932,0cyclictest10167-21sadc11:48:580
110329932,0cyclictest0-21swapper/008:34:230
110329932,0cyclictest0-21swapper/007:59:120
110329932,0cyclictest0-21swapper/007:49:190
110329930,0cyclictest32624-21diskstats07:19:100
110329930,0cyclictest24580-21munin-node06:49:120
28405020,0irq/26-eth0-rx-0-21swapper/308:34:193
28405020,0irq/26-eth0-rx-0-21swapper/307:14:103
110329921,0cyclictest18237-21latency_hist11:53:580
110329921,0cyclictest0-21swapper/007:09:120
110329920,0cyclictest0-21swapper/009:39:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional