You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 10:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sun Jan 11, 2026 00:45:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44522213159,42sleep30-21swapper/319:07:313
45582200161,25sleep20-21swapper/219:08:552
46292197160,24sleep10-21swapper/119:09:501
44592197158,25sleep00-21swapper/019:07:360
244272780,0sleep00-21swapper/021:40:430
294722590,0sleep00-21swapper/023:09:070
4735991412,1cyclictest28-21ksoftirqd/220:50:002
4718991412,1cyclictest10212-21sed00:05:150
4718991411,2cyclictest0-21swapper/020:40:170
473599130,1cyclictest0-21swapper/223:50:142
472299130,0cyclictest0-21swapper/122:23:101
471899133,9cyclictest28136-21ssh22:26:060
4718991312,1cyclictest3442-21grep23:15:210
4718991311,1cyclictest25414-21/usr/sbin/munin00:25:170
4718991311,1cyclictest14911-21ntpq23:30:170
4742991212,0cyclictest35-21ksoftirqd/323:46:383
4742991212,0cyclictest35-21ksoftirqd/323:37:023
4742991210,2cyclictest28376-21df21:05:133
4742991210,2cyclictest23501-21python22:20:173
4742991210,1cyclictest1747-21ntpd20:40:173
474299121,6cyclictest35-21ksoftirqd/322:50:133
4735991211,1cyclictest28-21ksoftirqd/221:55:002
4735991211,1cyclictest28-21ksoftirqd/221:30:112
472299120,12cyclictest0-21swapper/122:34:191
472299120,12cyclictest0-21swapper/122:11:581
472299120,12cyclictest0-21swapper/122:00:461
472299120,12cyclictest0-21swapper/121:04:451
472299120,12cyclictest0-21swapper/100:26:191
472299120,0cyclictest0-21swapper/119:24:021
471899129,2cyclictest30137-21/usr/sbin/munin23:10:130
471899122,9cyclictest12357-21ssh23:27:250
471899122,2cyclictest10073-21ssh22:05:110
4718991210,1cyclictest2857-21ntpq20:10:190
4718991210,1cyclictest25753-21apt-config23:05:000
4718991210,1cyclictest0-21swapper/023:40:160
4718991210,1cyclictest0-21swapper/019:20:120
98692110,0sleep10-21swapper/100:05:141
474299119,1cyclictest6449-21apt-get20:20:113
474299119,1cyclictest3445-21sed23:15:213
474299112,8cyclictest341rcuc/323:25:123
4742991111,0cyclictest35-21ksoftirqd/323:32:173
4742991111,0cyclictest35-21ksoftirqd/321:42:073
4742991110,1cyclictest10211-21grep00:05:163
474299111,2cyclictest23549-21head23:40:223
473599119,1cyclictest28-21ksoftirqd/221:05:132
473599119,1cyclictest28-21ksoftirqd/200:20:142
473599119,1cyclictest28-21ksoftirqd/200:10:002
4735991111,0cyclictest0-21swapper/223:55:562
4735991110,1cyclictest28-21ksoftirqd/223:20:002
472299110,11cyclictest0-21swapper/123:41:301
472299110,11cyclictest0-21swapper/120:42:221
472299110,11cyclictest0-21swapper/119:46:231
472299110,11cyclictest0-21swapper/119:46:231
472299110,0cyclictest0-21swapper/121:49:321
472299110,0cyclictest0-21swapper/121:38:221
472299110,0cyclictest0-21swapper/119:12:501
471899119,1cyclictest293502sleep023:49:430
471899119,1cyclictest18928-21cstates21:35:130
471899118,2cyclictest0-21swapper/019:35:170
471899117,3cyclictest0-21swapper/019:40:130
471899112,2cyclictest7606-21ssh00:01:180
4718991110,1cyclictest0-21swapper/022:55:390
4718991110,1cyclictest0-21swapper/022:20:180
4718991110,1cyclictest0-21swapper/021:45:170
4718991110,1cyclictest0-21swapper/021:05:140
4718991110,1cyclictest0-21swapper/020:20:110
4718991110,1cyclictest0-21swapper/000:30:520
474299108,1cyclictest35-21ksoftirqd/320:55:003
474299108,1cyclictest18856-21sh00:15:193
474299108,1cyclictest1257-21latency_hist23:55:013
474299107,2cyclictest5940-21smartctl19:10:143
474299105,4cyclictest23146-21apt-get20:55:103
474299102,7cyclictest341rcuc/320:48:573
474299102,7cyclictest341rcuc/319:58:583
474299101,8cyclictest8922-21ssh00:04:323
474299101,8cyclictest26476-21/usr/sbin/munin21:45:163
474299101,1cyclictest25300-21cat00:25:003
474299100,9cyclictest3738-21ssh21:16:003
474299100,9cyclictest29641-21ssh22:29:503
474299100,9cyclictest26351-21irqstats00:25:163
474299100,9cyclictest20621-21tune2fs19:40:143
474299100,8cyclictest10067-21apt-get22:05:113
474299100,2cyclictest31156-21users20:00:223
473599109,1cyclictest28-21ksoftirqd/222:50:132
473599109,1cyclictest28-21ksoftirqd/222:30:132
473599109,1cyclictest28-21ksoftirqd/222:25:142
473599109,1cyclictest28-21ksoftirqd/220:30:142
473599109,1cyclictest28-21ksoftirqd/220:15:002
473599109,1cyclictest28-21ksoftirqd/219:55:152
473599109,1cyclictest28-21ksoftirqd/219:20:132
473599109,1cyclictest28-21ksoftirqd/200:30:142
473599109,1cyclictest28-21ksoftirqd/200:30:002
473599109,1cyclictest28-21ksoftirqd/200:10:132
473599109,1cyclictest28-21ksoftirqd/200:00:122
473599108,2cyclictest28-21ksoftirqd/223:40:012
473599108,1cyclictest28-21ksoftirqd/223:30:152
473599108,1cyclictest28-21ksoftirqd/223:20:222
473599108,1cyclictest28-21ksoftirqd/223:00:002
473599108,1cyclictest28-21ksoftirqd/221:25:152
473599108,1cyclictest28-21ksoftirqd/219:20:002
473599100,5cyclictest5134-21apt-get19:10:102
472299109,1cyclictest21-21ksoftirqd/120:35:141
472299101,7cyclictest111rcu_preempt20:45:221
472299100,0cyclictest0-21swapper/122:45:321
472299100,0cyclictest0-21swapper/120:53:341
472299100,0cyclictest0-21swapper/119:57:351
471899109,1cyclictest0-21swapper/023:55:010
471899109,1cyclictest0-21swapper/023:35:240
471899109,1cyclictest0-21swapper/023:22:190
471899109,1cyclictest0-21swapper/020:34:550
471899104,6cyclictest0-21swapper/021:15:190
471899102,7cyclictest5020-21ssh21:58:110
471899102,7cyclictest0-21swapper/020:25:170
471899102,1cyclictest29996-21diskmemload21:53:250
471899102,1cyclictest12675-21ssh22:48:350
471899102,1cyclictest0-21swapper/020:55:120
471899101,8cyclictest9-21ksoftirqd/022:19:030
47429999,0cyclictest35-21ksoftirqd/323:57:013
47429999,0cyclictest35-21ksoftirqd/322:37:293
47429999,0cyclictest35-21ksoftirqd/322:31:343
47429999,0cyclictest35-21ksoftirqd/321:50:243
47429998,1cyclictest0-21swapper/323:22:193
47429998,1cyclictest0-21swapper/322:55:393
47429998,1cyclictest0-21swapper/300:35:183
47429998,1cyclictest0-21swapper/300:35:183
47429998,1cyclictest0-21swapper/300:30:523
47429997,1cyclictest11124-21fschecks_count19:20:123
47429996,2cyclictest32639-21ssh23:12:053
47429991,8cyclictest35-21ksoftirqd/320:30:103
47429991,1cyclictest4576-21diskstats20:15:143
47429991,1cyclictest35-21ksoftirqd/321:35:003
47429991,1cyclictest341rcuc/319:35:013
47429991,1cyclictest11545-21diskmemload21:25:203
47429991,0cyclictest19968-21ssh22:15:383
47429990,8cyclictest476-21ssh21:13:083
47429990,8cyclictest35-21ksoftirqd/323:05:003
47429990,8cyclictest341rcuc/323:01:003
47429990,8cyclictest341rcuc/319:45:123
47429990,8cyclictest341rcuc/319:45:123
47429990,1cyclictest8866-21cut19:15:123
47429990,0cyclictest35-21ksoftirqd/300:10:043
47359998,1cyclictest28-21ksoftirqd/223:40:152
47359998,1cyclictest28-21ksoftirqd/223:05:152
47359998,1cyclictest28-21ksoftirqd/223:00:192
47359998,1cyclictest28-21ksoftirqd/222:05:132
47359998,1cyclictest28-21ksoftirqd/221:55:582
47359998,1cyclictest28-21ksoftirqd/221:45:112
47359998,1cyclictest28-21ksoftirqd/221:15:132
47359998,1cyclictest28-21ksoftirqd/221:15:002
47359998,1cyclictest28-21ksoftirqd/221:00:162
47359998,1cyclictest28-21ksoftirqd/220:40:152
47359998,1cyclictest28-21ksoftirqd/220:05:002
47359998,1cyclictest28-21ksoftirqd/219:30:142
47359997,1cyclictest28-21ksoftirqd/223:45:132
47359997,1cyclictest28-21ksoftirqd/222:20:112
47359997,1cyclictest28-21ksoftirqd/220:15:142
47359997,1cyclictest28-21ksoftirqd/220:05:132
47359992,5cyclictest18065-21apt-get22:15:122
47359990,6cyclictest0-21swapper/221:40:112
47229998,1cyclictest21-21ksoftirqd/123:45:121
47229998,1cyclictest21-21ksoftirqd/122:30:001
47229998,1cyclictest21-21ksoftirqd/122:05:141
47229998,1cyclictest21-21ksoftirqd/121:25:141
47229998,1cyclictest21-21ksoftirqd/100:30:161
47229997,1cyclictest21-21ksoftirqd/123:55:101
47229990,8cyclictest111rcu_preempt23:50:141
47229990,8cyclictest111rcu_preempt23:03:291
47189998,1cyclictest0-21swapper/000:35:030
47189998,1cyclictest0-21swapper/000:35:030
47189996,2cyclictest0-21swapper/021:10:140
47189992,6cyclictest7288-21munin-node22:10:040
47189992,6cyclictest13726-21ssh22:50:050
47189991,8cyclictest9-21ksoftirqd/022:00:130
47189991,8cyclictest9-21ksoftirqd/021:25:270
47189991,8cyclictest9-21ksoftirqd/021:00:290
47189991,8cyclictest9-21ksoftirqd/020:45:070
47189991,8cyclictest9-21ksoftirqd/020:15:030
47189991,8cyclictest9-21ksoftirqd/020:05:110
47189991,8cyclictest9-21ksoftirqd/020:00:090
47189991,8cyclictest9-21ksoftirqd/019:25:230
47189991,0cyclictest9-21ksoftirqd/023:55:270
47189991,0cyclictest9-21ksoftirqd/022:40:270
47189991,0cyclictest9-21ksoftirqd/022:35:270
47189991,0cyclictest9-21ksoftirqd/022:30:430
47189991,0cyclictest9-21ksoftirqd/021:30:070
47189991,0cyclictest9-21ksoftirqd/021:20:410
47189991,0cyclictest9-21ksoftirqd/020:50:090
47189991,0cyclictest9-21ksoftirqd/020:35:030
47189991,0cyclictest9-21ksoftirqd/019:55:330
47189991,0cyclictest9-21ksoftirqd/019:50:410
47189991,0cyclictest9-21ksoftirqd/019:45:020
47189991,0cyclictest9-21ksoftirqd/019:45:010
47189991,0cyclictest9-21ksoftirqd/019:15:310
47189991,0cyclictest9-21ksoftirqd/019:10:040
47189991,0cyclictest9-21ksoftirqd/000:21:070
47189991,0cyclictest9-21ksoftirqd/000:15:010
47189991,0cyclictest9-21ksoftirqd/000:10:290
47189990,7cyclictest0-21swapper/019:30:110
47429988,0cyclictest35-21ksoftirqd/322:45:323
47429988,0cyclictest35-21ksoftirqd/321:55:033
47429988,0cyclictest35-21ksoftirqd/321:00:553
47429988,0cyclictest35-21ksoftirqd/319:25:163
47429987,1cyclictest35-21ksoftirqd/322:00:153
47429987,1cyclictest0-21swapper/320:10:193
47429981,7cyclictest35-21ksoftirqd/319:50:123
47429980,8cyclictest35-21ksoftirqd/322:40:243
47429980,8cyclictest35-21ksoftirqd/322:10:123
47429980,8cyclictest35-21ksoftirqd/321:35:123
47429980,8cyclictest35-21ksoftirqd/320:37:003
47429980,8cyclictest35-21ksoftirqd/320:06:453
47429980,8cyclictest35-21ksoftirqd/319:35:103
47429980,7cyclictest341rcuc/321:20:183
47429980,7cyclictest341rcuc/320:25:163
47359987,1cyclictest28-21ksoftirqd/223:25:132
47359987,1cyclictest28-21ksoftirqd/222:35:202
47359987,1cyclictest28-21ksoftirqd/222:00:112
47359987,1cyclictest28-21ksoftirqd/221:35:132
47359987,1cyclictest28-21ksoftirqd/221:21:522
47359987,1cyclictest28-21ksoftirqd/220:30:012
47359987,1cyclictest28-21ksoftirqd/219:45:152
47359987,1cyclictest28-21ksoftirqd/219:45:142
47359987,1cyclictest28-21ksoftirqd/219:35:122
47359987,1cyclictest28-21ksoftirqd/200:35:152
47359987,1cyclictest28-21ksoftirqd/200:35:152
47359986,1cyclictest7279-21kworker/2:119:50:122
47359986,1cyclictest61650irq/122-eno122:14:172
47359986,1cyclictest61650irq/122-eno100:15:212
47359986,1cyclictest28-21ksoftirqd/222:50:012
47359986,1cyclictest28-21ksoftirqd/219:40:132
47359986,1cyclictest28-21ksoftirqd/219:25:142
47229988,0cyclictest21-21ksoftirqd/123:35:161
47229988,0cyclictest21-21ksoftirqd/123:15:051
47229988,0cyclictest21-21ksoftirqd/123:10:141
47229988,0cyclictest21-21ksoftirqd/123:05:221
47229988,0cyclictest21-21ksoftirqd/121:09:521
47229988,0cyclictest21-21ksoftirqd/120:32:201
47229988,0cyclictest21-21ksoftirqd/120:15:341
47229988,0cyclictest21-21ksoftirqd/100:35:201
47229988,0cyclictest21-21ksoftirqd/100:35:201
47229988,0cyclictest111rcu_preempt22:50:151
47229988,0cyclictest0-21swapper/123:25:471
47229988,0cyclictest0-21swapper/123:22:211
47229988,0cyclictest0-21swapper/122:40:131
47229988,0cyclictest0-21swapper/122:35:231
47229988,0cyclictest0-21swapper/121:15:091
47229987,1cyclictest21-21ksoftirqd/123:32:361
47229987,1cyclictest21-21ksoftirqd/122:55:421
47229987,1cyclictest21-21ksoftirqd/121:50:121
47229987,1cyclictest21-21ksoftirqd/121:30:181
47229987,1cyclictest21-21ksoftirqd/120:05:201
47229987,1cyclictest21-21ksoftirqd/120:00:161
47229987,1cyclictest21-21ksoftirqd/119:35:191
47229987,1cyclictest21-21ksoftirqd/100:10:181
47229987,0cyclictest111rcu_preempt21:41:371
47229982,4cyclictest111rcu_preempt00:15:131
47229981,3cyclictest111rcu_preempt20:25:001
47229980,8cyclictest21-21ksoftirqd/121:10:311
47229980,8cyclictest0-21swapper/119:41:371
47229980,8cyclictest0-21swapper/100:21:111
47229980,8cyclictest0-21swapper/100:00:171
47229980,7cyclictest111rcu_preempt21:55:131
47229980,6cyclictest56-21kworker/1:120:11:561
47229980,0cyclictest111rcu_preempt22:15:511
47359976,1cyclictest61650irq/122-eno122:40:122
47359976,1cyclictest28-21ksoftirqd/223:10:112
47359976,1cyclictest28-21ksoftirqd/220:55:132
47359976,1cyclictest28-21ksoftirqd/220:50:142
47359976,1cyclictest28-21ksoftirqd/220:20:132
47229977,0cyclictest0-21swapper/120:25:151
47229977,0cyclictest0-21swapper/119:50:051
47229977,0cyclictest0-21swapper/119:30:161
47229977,0cyclictest0-21swapper/119:25:071
47229977,0cyclictest0-21swapper/119:15:071
47229970,7cyclictest0-21swapper/120:55:151
47229970,0cyclictest0-21swapper/121:20:401
47359966,0cyclictest61650irq/122-eno120:35:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional