You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 11:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Dec 08, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
150202202162,26sleep00-21swapper/019:09:340
147802200159,27sleep20-21swapper/219:06:302
147512198161,24sleep30-21swapper/319:06:073
129182198159,26sleep10-21swapper/119:05:011
15140991412,1cyclictest9-21ksoftirqd/019:15:000
15140991312,1cyclictest9-21ksoftirqd/020:20:130
15140991311,1cyclictest9-21ksoftirqd/000:10:130
15161991211,1cyclictest35-21ksoftirqd/322:40:003
15140991211,1cyclictest9-21ksoftirqd/021:35:190
15140991210,1cyclictest9-21ksoftirqd/000:15:230
15161991111,0cyclictest35-21ksoftirqd/319:35:153
15156991110,1cyclictest28-21ksoftirqd/223:40:182
1514899110,5cyclictest0-21swapper/121:51:111
1514099119,1cyclictest9-21ksoftirqd/022:55:220
1514099119,1cyclictest9-21ksoftirqd/020:10:150
15140991111,0cyclictest9-21ksoftirqd/023:20:020
15140991111,0cyclictest9-21ksoftirqd/022:28:500
15140991110,1cyclictest9-21ksoftirqd/023:50:220
15140991110,1cyclictest9-21ksoftirqd/023:10:210
15140991110,1cyclictest9-21ksoftirqd/023:10:200
15140991110,1cyclictest9-21ksoftirqd/022:50:200
15140991110,1cyclictest9-21ksoftirqd/022:50:010
15140991110,1cyclictest9-21ksoftirqd/021:50:170
45142100,0sleep30-21swapper/321:49:293
1516199109,1cyclictest35-21ksoftirqd/323:20:213
1516199108,1cyclictest35-21ksoftirqd/300:20:123
15161991010,0cyclictest35-21ksoftirqd/323:00:013
1515699108,1cyclictest28-21ksoftirqd/223:15:142
1515699100,6cyclictest7848-21diskmemload22:13:412
1514099109,1cyclictest9-21ksoftirqd/023:55:150
1514099109,1cyclictest9-21ksoftirqd/023:45:140
1514099109,1cyclictest9-21ksoftirqd/023:40:000
1514099109,1cyclictest9-21ksoftirqd/023:25:150
1514099109,1cyclictest9-21ksoftirqd/022:40:160
1514099109,1cyclictest9-21ksoftirqd/022:35:180
1514099109,1cyclictest9-21ksoftirqd/022:35:000
1514099109,1cyclictest9-21ksoftirqd/022:05:190
1514099109,1cyclictest9-21ksoftirqd/021:55:220
1514099109,1cyclictest9-21ksoftirqd/021:30:100
1514099109,1cyclictest9-21ksoftirqd/021:10:140
1514099109,1cyclictest9-21ksoftirqd/000:30:110
1514099109,1cyclictest9-21ksoftirqd/000:30:010
1514099108,1cyclictest9-21ksoftirqd/021:45:230
1514099108,1cyclictest9-21ksoftirqd/021:00:150
1514099108,1cyclictest9-21ksoftirqd/019:15:000
15140991010,0cyclictest9-21ksoftirqd/023:33:400
1514099101,4cyclictest11762-21latency_hist20:09:590
151619998,1cyclictest35-21ksoftirqd/322:20:013
151619998,1cyclictest35-21ksoftirqd/322:05:173
151569998,1cyclictest28-21ksoftirqd/223:25:002
151569997,1cyclictest28-21ksoftirqd/222:54:292
151569997,1cyclictest28-21ksoftirqd/221:49:392
151569991,5cyclictest0-21swapper/200:00:252
151569990,7cyclictest13020-21kworker/u8:100:27:392
151489998,1cyclictest0-21swapper/122:30:141
151409999,0cyclictest9-21ksoftirqd/000:20:000
151409998,1cyclictest9-21ksoftirqd/020:55:180
151409998,1cyclictest9-21ksoftirqd/020:00:210
151409998,0cyclictest24600-21ssh23:03:200
151409997,1cyclictest9-21ksoftirqd/020:20:000
151409994,5cyclictest9-21ksoftirqd/020:50:230
151409990,8cyclictest0-21swapper/021:15:130
151619988,0cyclictest35-21ksoftirqd/323:50:013
151619988,0cyclictest35-21ksoftirqd/323:02:313
151619987,1cyclictest35-21ksoftirqd/322:52:283
151619987,1cyclictest35-21ksoftirqd/320:35:013
151619986,1cyclictest35-21ksoftirqd/320:59:593
151619986,1cyclictest35-21ksoftirqd/300:30:013
151619980,8cyclictest0-21swapper/322:40:173
151569987,1cyclictest60950irq/123-eno100:14:092
151569987,1cyclictest28-21ksoftirqd/222:25:142
151569987,1cyclictest28-21ksoftirqd/221:45:002
151569986,1cyclictest60950irq/123-eno122:40:132
151569986,1cyclictest60950irq/123-eno122:37:412
151569986,1cyclictest60950irq/123-eno122:31:272
151569986,1cyclictest60950irq/123-eno100:05:192
151569986,1cyclictest28-21ksoftirqd/223:59:592
151569981,5cyclictest0-21swapper/223:30:182
151569980,4cyclictest0-21swapper/221:50:192
151569980,3cyclictest0-21swapper/222:55:242
151489980,7cyclictest0-21swapper/123:20:021
151489980,7cyclictest0-21swapper/121:45:211
151409988,0cyclictest9-21ksoftirqd/022:00:210
151409987,1cyclictest9-21ksoftirqd/022:10:180
151409987,1cyclictest9-21ksoftirqd/021:40:130
151409987,1cyclictest9-21ksoftirqd/019:30:150
151409987,1cyclictest9-21ksoftirqd/000:00:180
151409986,1cyclictest9-21ksoftirqd/023:40:170
151409984,1cyclictest27944-21nscd21:24:400
151409981,5cyclictest25428-21apt-get23:05:180
151409980,7cyclictest28232-21ssh22:21:290
151409980,4cyclictest21422-21perf20:30:000
151409980,1cyclictest27346-21ssh00:39:270
151409980,1cyclictest21699-21kernelversion19:20:170
151619977,0cyclictest35-21ksoftirqd/321:05:183
151619976,1cyclictest35-21ksoftirqd/322:30:013
151619976,1cyclictest35-21ksoftirqd/321:35:143
151619976,1cyclictest35-21ksoftirqd/320:50:173
151619972,3cyclictest26363-21kernelversion23:05:233
151619972,2cyclictest7848-21diskmemload23:55:163
151619971,3cyclictest17791-21apt-get23:40:133
151619970,5cyclictest17520-21munin-node19:42:063
151619970,5cyclictest17520-21munin-node19:42:063
151619970,5cyclictest0-21swapper/323:15:123
151619970,5cyclictest0-21swapper/321:33:423
151619970,4cyclictest0-21swapper/321:25:203
151619970,4cyclictest0-21swapper/300:15:133
151619970,3cyclictest0-21swapper/323:36:123
151619970,3cyclictest0-21swapper/321:53:173
151619970,2cyclictest0-21swapper/321:43:173
151569976,1cyclictest60950irq/123-eno123:54:552
151569976,1cyclictest60950irq/123-eno123:48:422
151569976,1cyclictest60950irq/123-eno123:10:122
151569976,1cyclictest60950irq/123-eno123:10:112
151569976,1cyclictest60950irq/123-eno123:02:592
151569976,1cyclictest60950irq/123-eno100:32:542
151569976,1cyclictest60950irq/123-eno100:20:192
151569976,1cyclictest17524-21sendmail-msp23:40:002
151569976,0cyclictest60950irq/123-eno121:16:302
151569975,1cyclictest60950irq/123-eno123:25:162
151569975,1cyclictest28-21ksoftirqd/221:35:012
151569973,2cyclictest570-21systemd-logind20:25:212
151569971,5cyclictest60950irq/123-eno121:55:382
151569971,4cyclictest28-21ksoftirqd/222:45:252
151569971,4cyclictest0-21swapper/222:20:192
151569970,4cyclictest29408-21fschecks_time20:45:162
151569970,3cyclictest26384-21latency23:05:232
151569970,3cyclictest0-21swapper/220:20:132
151569970,2cyclictest0-21swapper/200:35:012
151489974,2cyclictest0-21swapper/122:25:121
151489971,2cyclictest178942sleep122:54:311
151489971,2cyclictest0-21swapper/123:26:401
151489970,7cyclictest0-21swapper/123:10:181
151489970,7cyclictest0-21swapper/123:10:171
151489970,4cyclictest0-21swapper/121:15:231
151409976,1cyclictest9-21ksoftirqd/023:15:120
151409972,2cyclictest0-21swapper/020:45:130
151409970,6cyclictest3322-21cat00:05:140
151409970,6cyclictest0-21swapper/021:25:070
151409970,6cyclictest0-21swapper/019:25:120
151409970,2cyclictest7848-21diskmemload22:15:200
151409970,2cyclictest0-21swapper/019:55:140
12019270,2sleep10-21swapper/122:00:131
31431260,0sleep10-21swapper/121:40:181
17390260,1sleep10-21swapper/121:20:591
151619966,0cyclictest35-21ksoftirqd/322:30:003
151619966,0cyclictest35-21ksoftirqd/319:20:143
151619966,0cyclictest35-21ksoftirqd/300:05:153
151619966,0cyclictest0-21swapper/323:31:193
151619965,1cyclictest8427-21ssh21:55:033
151619965,1cyclictest35-21ksoftirqd/300:00:183
151619965,1cyclictest31251-21ssh23:12:153
151619965,1cyclictest31251-21ssh23:12:153
151619964,1cyclictest35-21ksoftirqd/319:50:013
151619963,1cyclictest6471-21/usr/sbin/munin00:10:153
151619963,1cyclictest570-21systemd-logind22:45:223
151619963,1cyclictest19114-21aten2.4-expect22:10:123
151619962,2cyclictest254-21systemd-journal20:46:403
151619962,2cyclictest23130-21apt-get19:25:123
151619961,2cyclictest7848-21diskmemload22:00:083
151619961,1cyclictest25222-21ls00:35:173
151619960,6cyclictest28488-21ssh22:22:193
151619960,6cyclictest22833-21ssh00:31:273
151619960,5cyclictest0-21swapper/323:50:013
151619960,3cyclictest0-21swapper/323:26:293
151619960,1cyclictest0-21swapper/321:17:453
151569966,0cyclictest60950irq/123-eno122:05:202
151569966,0cyclictest60950irq/123-eno122:00:072
151569966,0cyclictest60950irq/123-eno121:35:122
151569966,0cyclictest60950irq/123-eno121:25:072
151569966,0cyclictest60950irq/123-eno121:10:152
151569966,0cyclictest60950irq/123-eno121:05:222
151569966,0cyclictest60950irq/123-eno120:41:312
151569966,0cyclictest60950irq/123-eno120:13:102
151569966,0cyclictest60950irq/123-eno120:05:322
151569966,0cyclictest60950irq/123-eno119:53:102
151569966,0cyclictest60950irq/123-eno119:48:162
151569966,0cyclictest60950irq/123-eno119:35:262
151569966,0cyclictest60950irq/123-eno119:25:542
151569966,0cyclictest60950irq/123-eno119:17:092
151569966,0cyclictest60950irq/123-eno119:13:582
151569966,0cyclictest60950irq/123-eno100:15:542
151569965,1cyclictest28-21ksoftirqd/220:35:002
151569965,1cyclictest28-21ksoftirqd/219:55:012
151569965,1cyclictest28-21ksoftirqd/219:40:012
151569965,1cyclictest28-21ksoftirqd/219:40:002
151569964,1cyclictest8138-21/usr/sbin/munin20:00:162
151569964,1cyclictest60950irq/123-eno121:20:142
151569963,2cyclictest14612-21tr20:15:162
151569961,3cyclictest0-21swapper/222:15:122
151569960,4cyclictest0-21swapper/220:55:142
151489961,2cyclictest0-21swapper/123:18:101
151489961,2cyclictest0-21swapper/119:30:191
151489960,6cyclictest0-21swapper/100:29:051
151489960,6cyclictest0-21swapper/100:18:001
151489960,5cyclictest0-21swapper/121:35:131
151489960,4cyclictest0-21swapper/122:37:451
151489960,4cyclictest0-21swapper/120:25:191
151489960,4cyclictest0-21swapper/100:05:571
151489960,2cyclictest0-21swapper/123:44:451
151489960,0cyclictest0-21swapper/123:45:121
151489960,0cyclictest0-21swapper/122:12:061
151409965,1cyclictest9-21ksoftirqd/019:45:120
151409965,1cyclictest9-21ksoftirqd/019:35:120
151409964,1cyclictest9-21ksoftirqd/020:35:150
151409964,1cyclictest9-21ksoftirqd/020:34:550
151409964,1cyclictest9-21ksoftirqd/019:40:180
151409964,1cyclictest9-21ksoftirqd/019:40:180
151409960,2cyclictest0-21swapper/021:05:150
151619955,0cyclictest35-21ksoftirqd/321:00:143
151619955,0cyclictest35-21ksoftirqd/320:20:013
151619954,1cyclictest35-21ksoftirqd/321:20:183
151619954,1cyclictest35-21ksoftirqd/320:30:003
151619954,1cyclictest35-21ksoftirqd/319:15:003
151619952,1cyclictest278-21systemd-udevd20:43:103
151619950,2cyclictest0-21swapper/321:10:183
151619950,2cyclictest0-21swapper/320:05:153
151619950,1cyclictest254-21systemd-journal20:01:403
151619950,0cyclictest0-21swapper/319:14:593
151569955,0cyclictest60950irq/123-eno120:50:462
151569955,0cyclictest60950irq/123-eno119:30:162
151569955,0cyclictest60950irq/123-eno119:21:322
151569954,1cyclictest60950irq/123-eno121:00:172
151569954,1cyclictest60950irq/123-eno120:35:162
151489955,0cyclictest0-21swapper/122:49:351
151489953,1cyclictest8527-21chrt00:11:131
151489953,1cyclictest31373-21chrt20:50:141
151489950,5cyclictest0-21swapper/123:55:041
151489950,5cyclictest0-21swapper/119:51:461
151489950,5cyclictest0-21swapper/100:36:331
151489950,4cyclictest0-21swapper/122:22:471
151489950,4cyclictest0-21swapper/119:15:181
151489950,3cyclictest0-21swapper/123:54:251
151489950,3cyclictest0-21swapper/123:35:381
151489950,3cyclictest0-21swapper/122:05:231
151489950,3cyclictest0-21swapper/120:25:001
151489950,3cyclictest0-21swapper/100:21:081
151489950,3cyclictest0-21swapper/100:00:551
151489950,2cyclictest0-21swapper/123:31:121
151489950,2cyclictest0-21swapper/123:05:031
151489950,2cyclictest0-21swapper/122:55:221
151489950,2cyclictest0-21swapper/122:15:211
151489950,2cyclictest0-21swapper/121:12:571
151489950,2cyclictest0-21swapper/120:40:181
151489950,2cyclictest0-21swapper/100:31:501
151489950,1cyclictest0-21swapper/123:01:001
151489950,1cyclictest0-21swapper/122:40:571
151489950,1cyclictest0-21swapper/121:55:551
151489950,1cyclictest0-21swapper/121:34:191
151489950,1cyclictest0-21swapper/121:25:131
151489950,1cyclictest0-21swapper/120:35:141
151489950,0cyclictest0-21swapper/119:43:001
151489950,0cyclictest0-21swapper/119:42:591
151409953,2cyclictest0-21swapper/019:50:130
151409950,0cyclictest0-21swapper/020:40:180
151619943,1cyclictest35-21ksoftirqd/320:10:173
151619942,1cyclictest3573-21/usr/sbin/munin19:50:183
151619941,2cyclictest5796-21latency19:55:183
151619941,2cyclictest26612-21ntp_kernel_err19:30:203
151619941,1cyclictest15544-21grep20:15:213
151619940,3cyclictest23969-21/usr/sbin/munin20:35:173
151489944,0cyclictest0-21swapper/120:15:591
151489944,0cyclictest0-21swapper/119:10:461
151489942,2cyclictest0-21swapper/120:55:131
151489942,0cyclictest0-21swapper/120:45:141
151489941,0cyclictest0-21swapper/121:05:161
151489940,3cyclictest0-21swapper/119:55:141
151489940,1cyclictest0-21swapper/121:00:121
151489940,1cyclictest0-21swapper/120:10:161
151489940,1cyclictest0-21swapper/119:35:131
151489940,1cyclictest0-21swapper/119:20:141
151489931,1cyclictest0-21swapper/119:25:221
151489930,2cyclictest0-21swapper/120:00:121
151489930,1cyclictest0-21swapper/120:05:121
151489930,0cyclictest0-21swapper/120:30:151
151489930,0cyclictest0-21swapper/119:45:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional