You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 05:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 22, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
950024534,0sleep00-21swapper/018:50:510
943323725,0sleep30-21swapper/318:50:063
938023122,0sleep10-21swapper/118:49:271
949723021,0sleep20-21swapper/218:50:492
96699960,0cyclictest0-21swapper/221:50:252
96679960,0cyclictest0-21swapper/021:38:010
339960,0migration/38304-21aten_r1power_fr21:12:103
339960,0migration/35892-21sh23:49:153
339960,0migration/329946-21sh23:23:123
339960,0migration/323076-21sh21:00:043
339960,0migration/322561-21sh21:37:573
339960,0migration/314989-21sh20:55:353
29725060,0irq/27-eth0-tx-13668-21munin-node20:32:220
29725060,0irq/27-eth0-tx-10834-21munin-node19:17:230
29715060,0irq/26-eth0-rx-7203-21ssh21:50:313
149960,0migration/04613-21missed_timers23:27:180
149960,0migration/032380-21kthreadcore19:07:160
96699955,0cyclictest0-21swapper/222:56:192
96699955,0cyclictest0-21swapper/221:16:502
96699955,0cyclictest0-21swapper/200:05:312
96699950,0cyclictest0-21swapper/222:16:352
96689955,0cyclictest0-21swapper/123:57:061
96689955,0cyclictest0-21swapper/123:01:181
96689955,0cyclictest0-21swapper/122:00:261
96689950,0cyclictest0-21swapper/123:41:581
96689950,0cyclictest0-21swapper/122:56:341
96679955,0cyclictest0-21swapper/023:18:270
96679950,0cyclictest0-21swapper/023:23:300
35150,0ktimersoftd/30-21swapper/322:47:103
339950,0migration/39388-21kthreadcore23:52:173
339950,0migration/39325-21kthreadcore19:12:173
339950,0migration/39208-21kthreadcore23:12:163
339950,0migration/36326-21munin-node20:22:223
339950,0migration/35696-21diskmemload23:28:253
339950,0migration/331411-21taskset19:56:143
339950,0migration/331231-21latency_hist23:46:593
339950,0migration/326669-21kthreadcore19:27:173
339950,0migration/326038-21kthreadcore21:42:163
339950,0migration/325575-21kthreadcore19:02:173
339950,0migration/325575-21kthreadcore19:02:173
339950,0migration/323612-21latency_hist22:41:593
339950,0migration/322030-21taskset23:18:273
339950,0migration/319813-21kthreadcore19:22:163
339950,0migration/316233-21munin-node19:17:203
339950,0migration/314082-21taskset22:53:253
339950,0migration/311603-21kthreadcore21:32:183
339950,0migration/310443-21kthreadcore20:02:173
29725050,0irq/27-eth0-tx-6368-21ssh23:09:492
29725050,0irq/27-eth0-tx-5357-21open_files22:07:192
29725050,0irq/27-eth0-tx-31989-21munin-node22:27:112
29725050,0irq/27-eth0-tx-31564-21munin-node23:27:132
29725050,0irq/27-eth0-tx-31545-21aten_r1power_po23:47:122
29725050,0irq/27-eth0-tx-25098-21diskmemload21:02:162
29725050,0irq/27-eth0-tx-24745-21munin-node22:42:152
29725050,0irq/27-eth0-tx-24438-21munin-node21:22:132
29725050,0irq/27-eth0-tx-14680-21ssh00:16:432
29725050,0irq/27-eth0-tx-14359-21ssh23:34:592
29725050,0irq/27-eth0-tx-11671-21kthreadcore21:32:182
29725050,0irq/27-eth0-tx-0-21swapper/223:02:172
29725050,0irq/27-eth0-tx-0-21swapper/222:39:172
29725050,0irq/27-eth0-tx-0-21swapper/222:34:302
29725050,0irq/27-eth0-tx-0-21swapper/221:10:082
29725050,0irq/27-eth0-tx-0-21swapper/200:17:172
29725050,0irq/27-eth0-tx-0-21swapper/020:52:110
29725050,0irq/27-eth0-tx-0-21swapper/020:06:240
29725050,0irq/27-eth0-tx-0-21swapper/018:52:230
29715050,0irq/26-eth0-rx-4912-21munin-node23:07:183
29715050,0irq/26-eth0-rx-29867-21sendmail_mailqu21:02:223
29715050,0irq/26-eth0-rx-25874-21kthreadcore21:22:173
29715050,0irq/26-eth0-rx-23870-21fschecks_time00:02:123
29715050,0irq/26-eth0-rx-19124-21kthreadcore23:57:153
29715050,0irq/26-eth0-rx-0-21swapper/323:40:403
29715050,0irq/26-eth0-rx-0-21swapper/323:34:263
29715050,0irq/26-eth0-rx-0-21swapper/323:02:083
29715050,0irq/26-eth0-rx-0-21swapper/323:01:323
29715050,0irq/26-eth0-rx-0-21swapper/322:32:173
29715050,0irq/26-eth0-rx-0-21swapper/322:12:163
29715050,0irq/26-eth0-rx-0-21swapper/322:07:073
29715050,0irq/26-eth0-rx-0-21swapper/321:57:113
29715050,0irq/26-eth0-rx-0-21swapper/321:56:083
29715050,0irq/26-eth0-rx-0-21swapper/321:18:333
29715050,0irq/26-eth0-rx-0-21swapper/321:09:563
29715050,0irq/26-eth0-rx-0-21swapper/300:07:213
27150,0ktimersoftd/20-21swapper/221:59:522
259950,0migration/27289-21sh21:30:162
259950,0migration/231441-21munin-node20:17:162
259950,0migration/230506-21sh22:23:312
259950,0migration/229994-21timerandwakeup22:02:212
259950,0migration/227510-21kthreadcore19:52:162
259950,0migration/224528-21munin-node19:27:132
259950,0migration/222877-21sh20:59:342
259950,0migration/222700-21sh23:20:202
259950,0migration/221784-21timerandwakeup22:17:222
259950,0migration/22016-21kthreadcore20:22:152
259950,0migration/21250-21aten_r1power_en20:47:122
259950,0migration/21120-21kthreadcore00:07:172
19150,0ktimersoftd/10-21swapper/122:47:101
179950,0migration/18278-21sh22:12:121
179950,0migration/15287-21taskset00:08:011
179950,0migration/1411-21munin-node21:27:121
179950,0migration/127799-21kthreadcore22:42:171
179950,0migration/123124-21smart_sda19:22:211
179950,0migration/117951-21kthreadcore20:57:171
179950,0migration/113452-21taskset23:32:241
179950,0migration/113133-21munin-node20:07:151
169950,0watchdog/17151-21seq22:31:091
169950,0watchdog/16247-21sh21:07:381
169950,0watchdog/123931-21sh19:02:141
169950,0watchdog/123931-21sh19:02:141
169950,0watchdog/111968-21kthreadcore22:32:171
149950,0migration/08294-21munin-node22:32:130
149950,0migration/08055-21latency_hist21:31:590
149950,0migration/07392-21taskset23:12:040
149950,0migration/05614-21taskset23:07:430
149950,0migration/04889-21kthreadcore20:47:180
149950,0migration/04630-21munin-node19:57:170
149950,0migration/029776-21kthreadcore20:17:150
149950,0migration/029644-21timerwakeupswit23:02:220
149950,0migration/027972-21kthreadcore21:22:170
149950,0migration/027723-21kthreadcore00:02:160
149950,0migration/026013-21kthreadcore21:42:160
149950,0migration/02364-21kthreadcore21:47:160
149950,0migration/022828-21latency_hist00:21:590
149950,0migration/022493-21sh22:18:400
149950,0migration/020056-21kthreadcore22:57:150
149950,0migration/019798-21kthreadcore21:17:180
149950,0migration/018382-21taskset19:47:070
149950,0migration/013644-21pmu-power21:52:200
149950,0migration/013006-21munin-node20:27:200
96699943,0cyclictest8883-21awk21:52:142
96699943,0cyclictest3514-21snmpd20:43:412
96699943,0cyclictest3514-21snmpd20:37:262
96699943,0cyclictest3514-21snmpd20:27:262
96699943,0cyclictest3514-21snmpd20:04:262
96699943,0cyclictest3514-21snmpd19:11:112
96699943,0cyclictest25150-21awk21:42:142
96699943,0cyclictest17129-21awk21:37:132
96699943,0cyclictest16497-21awk22:57:122
96699943,0cyclictest14574-21awk20:32:142
96699943,0cyclictest12653-21awk19:42:142
96689944,0cyclictest0-21swapper/123:52:041
96689944,0cyclictest0-21swapper/123:23:501
96689944,0cyclictest0-21swapper/123:03:391
96689944,0cyclictest0-21swapper/121:53:581
96689944,0cyclictest0-21swapper/100:14:361
96689943,0cyclictest8301-21awk23:12:141
96689943,0cyclictest6029-21awk19:37:151
96689943,0cyclictest3556-21lldpd21:43:141
96689943,0cyclictest3556-21lldpd21:25:441
96689943,0cyclictest3514-21snmpd22:24:261
96689943,0cyclictest3514-21snmpd22:09:261
96689943,0cyclictest3514-21snmpd19:14:411
96689943,0cyclictest3241-21irqbalance23:43:371
96689943,0cyclictest3241-21irqbalance20:56:581
96689943,0cyclictest27836-21awk20:42:131
96689943,0cyclictest24951-21awk19:27:151
96689943,0cyclictest16026-21awk00:17:131
96689943,0cyclictest12961-21sort18:52:191
96689943,0cyclictest12629-21awk19:42:141
96689943,0cyclictest11670-21awk19:17:151
96679944,0cyclictest25181-21kworker/0:223:33:180
96679944,0cyclictest0-21swapper/021:08:040
96679943,0cyclictest532-21awk22:07:130
96679943,0cyclictest3556-21lldpd22:50:150
96679943,0cyclictest3241-21irqbalance23:37:070
96679943,0cyclictest3241-21irqbalance22:14:280
96679943,0cyclictest25181-21kworker/0:222:52:540
96679943,0cyclictest25181-21kworker/0:222:24:270
96679943,0cyclictest25181-21kworker/0:200:12:260
96679943,0cyclictest20205-21awk20:12:150
96679943,0cyclictest16085-21awk23:57:120
339940,0migration/37053-21diskmemload21:29:363
339940,0migration/329830-21kthreadcore20:42:153
339940,0migration/319858-21kthreadcore19:47:163
29725040,0irq/27-eth0-tx-7709-21diskmemload23:52:252
29725040,0irq/27-eth0-tx-26185-21kthreadcore23:22:162
29725040,0irq/27-eth0-tx-0-21swapper/223:42:192
29725040,0irq/27-eth0-tx-0-21swapper/223:38:362
29725040,0irq/27-eth0-tx-0-21swapper/223:12:002
29725040,0irq/27-eth0-tx-0-21swapper/222:47:002
29725040,0irq/27-eth0-tx-0-21swapper/220:52:442
29725040,0irq/27-eth0-tx-0-21swapper/019:52:180
29725040,0irq/27-eth0-tx-0-21swapper/019:42:110
29715040,0irq/26-eth0-rx-0-21swapper/322:43:053
29715040,0irq/26-eth0-rx-0-21swapper/322:27:403
29715040,0irq/26-eth0-rx-0-21swapper/322:22:113
29715040,0irq/26-eth0-rx-0-21swapper/322:17:133
29715040,0irq/26-eth0-rx-0-21swapper/322:03:213
29715040,0irq/26-eth0-rx-0-21swapper/319:45:113
29715040,0irq/26-eth0-rx-0-21swapper/300:17:163
29715040,0irq/26-eth0-rx-0-21swapper/300:12:143
259940,0migration/25088-21switchtime19:57:212
259940,0migration/231560-21idleruntime19:32:152
259940,0migration/220683-21munin-node23:57:162
259940,0migration/217981-21latency20:07:192
249940,0watchdog/25063-21if_eth1.219:12:142
249940,0watchdog/223597-21cat19:47:182
249940,0watchdog/214714-21tr19:17:182
249940,0watchdog/20-21swapper/221:17:142
249940,0watchdog/20-21swapper/220:12:182
249940,0watchdog/20-21swapper/219:22:142
249940,0watchdog/20-21swapper/218:59:262
179940,0migration/17846-21latency_hist21:51:591
179940,0migration/15969-21sh23:29:121
179940,0migration/15617-21sshd20:00:241
179940,0migration/131408-21taskset22:05:411
179940,0migration/130893-21irqcore19:07:161
179940,0migration/130880-21kthreadcore20:17:151
179940,0migration/124581-21kthreadcore00:02:151
179940,0migration/119900-21kthreadcore22:37:161
179940,0migration/119128-21kthreadcore23:17:171
179940,0migration/11317-21kthreadcore23:47:181
179940,0migration/111979-21kthreadcore20:27:151
179940,0migration/111915-21timerwakeupswit20:02:221
179940,0migration/111304-21kthreadcore21:12:161
169940,0watchdog/125016-21sendmail_mailqu20:12:221
169940,0watchdog/10-21swapper/123:09:211
169940,0watchdog/10-21swapper/122:17:131
169940,0watchdog/10-21swapper/121:02:181
149940,0migration/08258-21aten_r1power_en21:12:100
149940,0migration/05638-21fschecks_time19:37:130
149940,0migration/05448-21diskmemload22:27:210
149940,0migration/04802-21timerandwakeup00:07:230
149940,0migration/022608-21kthreadcore20:37:170
149940,0migration/017526-21kthreadcore20:57:170
149940,0migration/013913-21irqrtprio20:07:180
96699930,0cyclictest11061-21users19:37:232
96689933,0cyclictest3556-21lldpd20:37:131
96689932,0cyclictest8620-21cut21:32:141
96689932,0cyclictest3556-21lldpd21:38:141
96689932,0cyclictest26023-21grep19:52:151
96689932,0cyclictest17815-21grep20:32:171
96689932,0cyclictest1207-21munin-node20:47:141
96689930,0cyclictest528-21df20:22:101
96679933,0cyclictest25181-21kworker/0:223:52:020
96679933,0cyclictest25181-21kworker/0:223:47:040
96679933,0cyclictest25181-21kworker/0:223:42:000
96679933,0cyclictest25181-21kworker/0:222:42:000
96679933,0cyclictest25181-21kworker/0:222:37:000
96679933,0cyclictest25181-21kworker/0:222:02:010
96679933,0cyclictest25181-21kworker/0:221:57:010
96679933,0cyclictest25181-21kworker/0:221:02:110
96679933,0cyclictest25181-21kworker/0:220:42:010
96679933,0cyclictest25181-21kworker/0:220:22:110
96679933,0cyclictest23112-21kworker/0:019:32:010
96679933,0cyclictest23112-21kworker/0:019:27:010
96679933,0cyclictest23112-21kworker/0:019:22:010
96679933,0cyclictest23112-21kworker/0:019:02:110
96679933,0cyclictest23112-21kworker/0:019:02:110
96679933,0cyclictest23112-21kworker/0:018:57:150
96679931,0cyclictest536-21tune2fs21:27:120
29725030,0irq/27-eth0-tx-0-21swapper/019:12:100
29715030,0irq/26-eth0-rx-0-21swapper/320:47:123
29715030,0irq/26-eth0-rx-0-21swapper/320:37:103
29715030,0irq/26-eth0-rx-0-21swapper/320:35:013
29715030,0irq/26-eth0-rx-0-21swapper/320:27:093
29715030,0irq/26-eth0-rx-0-21swapper/320:18:493
29715030,0irq/26-eth0-rx-0-21swapper/320:12:233
29715030,0irq/26-eth0-rx-0-21swapper/320:07:133
29715030,0irq/26-eth0-rx-0-21swapper/319:32:113
29715030,0irq/26-eth0-rx-0-21swapper/319:07:113
29715030,0irq/26-eth0-rx-0-21swapper/318:57:113
29715030,0irq/26-eth0-rx-0-21swapper/318:52:123
249930,0watchdog/20-21swapper/219:02:142
249930,0watchdog/20-21swapper/219:02:142
249930,0watchdog/20-21swapper/218:52:142
179930,0migration/121209-21kthreadcore19:47:171
169930,0watchdog/10-21swapper/121:17:101
169930,0watchdog/10-21swapper/118:59:261
29715020,0irq/26-eth0-rx-0-21swapper/319:57:143
29715020,0irq/26-eth0-rx-0-21swapper/319:37:073
169920,0watchdog/10-21swapper/119:32:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional