You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 12:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Sat Dec 27, 2025 00:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138591232167,22phc2sys0-21swapper/319:08:053
33742201167,22sleep00-21swapper/019:06:440
36182199166,22sleep10-21swapper/119:09:541
34212198167,21sleep20-21swapper/219:07:222
38712750,2sleep10-21swapper/120:15:001
4110996129,4cyclictest33-21ksoftirqd/200:20:002
217292610,2sleep10-21swapper/120:50:141
4110995828,7cyclictest33-21ksoftirqd/222:30:012
4110995828,4cyclictest33-21ksoftirqd/200:05:292
410999577,15cyclictest1632-21latency_hist00:30:021
4110995636,3cyclictest33-21ksoftirqd/222:40:262
4110995629,6cyclictest33-21ksoftirqd/220:45:002
4110995628,3cyclictest33-21ksoftirqd/223:25:152
4110995628,3cyclictest33-21ksoftirqd/221:05:202
4110995526,4cyclictest33-21ksoftirqd/223:30:152
4110995433,3cyclictest33-21ksoftirqd/220:55:132
4110995427,7cyclictest33-21ksoftirqd/220:50:272
4110995425,4cyclictest33-21ksoftirqd/219:40:212
4110995424,6cyclictest33-21ksoftirqd/223:20:142
4110995414,10cyclictest33-21ksoftirqd/200:20:162
4110995327,8cyclictest33-21ksoftirqd/219:35:172
4110995327,7cyclictest33-21ksoftirqd/222:30:282
4110995325,5cyclictest33-21ksoftirqd/223:35:142
4110995325,4cyclictest33-21ksoftirqd/223:05:142
4110995324,7cyclictest33-21ksoftirqd/221:25:012
4110995323,5cyclictest33-21ksoftirqd/223:15:122
4110995323,4cyclictest33-21ksoftirqd/222:10:012
4110995323,4cyclictest33-21ksoftirqd/222:10:002
4110995321,5cyclictest33-21ksoftirqd/222:55:242
4110995320,4cyclictest33-21ksoftirqd/219:30:122
4110995317,6cyclictest33-21ksoftirqd/223:50:142
4110995226,7cyclictest33-21ksoftirqd/220:25:002
4110995226,3cyclictest33-21ksoftirqd/222:10:262
4110995223,4cyclictest33-21ksoftirqd/222:50:242
4110995221,5cyclictest33-21ksoftirqd/219:45:252
4110995214,7cyclictest33-21ksoftirqd/219:15:012
4110995131,3cyclictest33-21ksoftirqd/219:20:172
4110995127,7cyclictest33-21ksoftirqd/220:15:272
4110995125,7cyclictest33-21ksoftirqd/221:35:012
4110995125,7cyclictest33-21ksoftirqd/220:00:242
4110995122,4cyclictest33-21ksoftirqd/223:10:152
4110995118,6cyclictest33-21ksoftirqd/221:55:132
4110995020,6cyclictest33-21ksoftirqd/223:40:152
4110995017,4cyclictest33-21ksoftirqd/223:55:262
4110995014,6cyclictest33-21ksoftirqd/220:10:122
4110995014,6cyclictest33-21ksoftirqd/220:05:122
4110994924,7cyclictest33-21ksoftirqd/219:25:162
4110994922,6cyclictest33-21ksoftirqd/220:35:232
4110994919,6cyclictest33-21ksoftirqd/222:45:232
410999490,14cyclictest21621-21apt-get23:00:141
4110994822,4cyclictest33-21ksoftirqd/222:35:142
4110994819,6cyclictest33-21ksoftirqd/222:25:012
4110994814,4cyclictest33-21ksoftirqd/223:01:232
410999480,15cyclictest28927-21apt-get21:05:121
4110994723,4cyclictest33-21ksoftirqd/200:10:252
4110994720,7cyclictest33-21ksoftirqd/222:20:012
4110994718,7cyclictest33-21ksoftirqd/223:45:132
4110994718,3cyclictest33-21ksoftirqd/221:05:012
4110994715,6cyclictest33-21ksoftirqd/220:45:122
4110994712,6cyclictest33-21ksoftirqd/220:25:172
4108994731,13cyclictest9-21ksoftirqd/021:26:590
411099465,6cyclictest33-21ksoftirqd/221:25:262
4110994628,9cyclictest33-21ksoftirqd/200:00:272
4110994621,6cyclictest33-21ksoftirqd/219:10:242
4110994621,6cyclictest33-21ksoftirqd/219:10:242
4110994618,7cyclictest33-21ksoftirqd/221:45:222
4110994618,4cyclictest33-21ksoftirqd/200:25:132
411099455,2cyclictest33-21ksoftirqd/221:40:162
4110994526,2cyclictest33-21ksoftirqd/200:30:142
4110994521,7cyclictest33-21ksoftirqd/222:00:132
4110994521,7cyclictest33-21ksoftirqd/221:50:152
4110994519,7cyclictest33-21ksoftirqd/220:30:212
411099442,2cyclictest121rcu_preempt21:10:152
410999440,13cyclictest1862-21apt-get00:30:121
4108994428,13cyclictest9-21ksoftirqd/021:04:590
138491440,0ptp4l401ktimersoftd/319:35:273
138491430,0ptp4l401ktimersoftd/323:15:263
138491430,0ptp4l401ktimersoftd/319:47:033
138491430,0ptp4l401ktimersoftd/300:12:593
4110994215,4cyclictest33-21ksoftirqd/221:35:202
411099421,2cyclictest121rcu_preempt19:55:262
4109994237,3cyclictest19270-21fschecks_count21:50:131
410999420,7cyclictest21709-21diskstats21:55:141
138491420,0ptp4l401ktimersoftd/321:20:203
4111994111,27cyclictest12070-21expr19:25:133
4110994130,2cyclictest33-21ksoftirqd/219:50:172
410999410,14cyclictest8658-21users19:15:271
411099400,2cyclictest121rcu_preempt21:15:132
138491400,0ptp4l401ktimersoftd/300:25:023
4111993930,6cyclictest41-21ksoftirqd/322:04:073
4110993934,3cyclictest33-21ksoftirqd/200:40:012
4108993924,13cyclictest9-21ksoftirqd/021:32:590
50798380,3rtkit-daemon22618-21irqstats23:00:190
4111993831,5cyclictest41-21ksoftirqd/323:21:593
4109993833,3cyclictest25-21ksoftirqd/121:39:591
4109993832,3cyclictest25-21ksoftirqd/100:15:001
410999380,8cyclictest1962-21diskstats21:15:151
4111993732,3cyclictest41-21ksoftirqd/322:30:263
4111993714,20cyclictest13919-21/usr/sbin/munin20:35:213
4108993732,3cyclictest9-21ksoftirqd/019:30:540
4108993729,6cyclictest9-21ksoftirqd/020:15:000
411199363,30cyclictest11232-21idleruntime-cro20:30:013
4111993631,3cyclictest41-21ksoftirqd/320:11:123
4111993630,4cyclictest41-21ksoftirqd/321:52:423
4111993630,4cyclictest41-21ksoftirqd/321:06:213
4111993630,3cyclictest41-21ksoftirqd/320:20:003
4111993613,21cyclictest4148-21/usr/sbin/munin19:10:153
4111993613,21cyclictest4148-21/usr/sbin/munin19:10:153
411199360,34cyclictest12950-1kworker/3:2H19:25:003
4109993630,4cyclictest25-21ksoftirqd/122:57:461
4109993630,4cyclictest25-21ksoftirqd/119:50:171
4109993630,4cyclictest25-21ksoftirqd/100:24:161
4109993629,4cyclictest25-21ksoftirqd/123:45:011
410999360,7cyclictest31438-21apt21:10:131
410999360,7cyclictest2361-21iostat_ios23:25:191
4108993631,3cyclictest8838-21cron22:34:590
4108993630,4cyclictest9-21ksoftirqd/023:33:520
4108993630,4cyclictest9-21ksoftirqd/021:08:510
4108993630,4cyclictest9-21ksoftirqd/020:00:350
4108993630,4cyclictest9-21ksoftirqd/019:17:220
50798350,2rtkit-daemon0-21swapper/021:46:270
4111993529,4cyclictest41-21ksoftirqd/320:31:383
4111993513,19cyclictest19130-21/usr/sbin/munin22:55:253
4111993511,21cyclictest15166-21cut21:40:213
411199350,2cyclictest121rcu_preempt21:01:173
4109993530,3cyclictest23952-21cron00:09:591
4109993529,4cyclictest25-21ksoftirqd/119:43:311
4109993529,4cyclictest25-21ksoftirqd/119:21:491
4108993529,4cyclictest9-21ksoftirqd/020:29:230
4108993528,5cyclictest9-21ksoftirqd/020:21:400
4108993528,4cyclictest9-21ksoftirqd/020:19:520
138491350,0ptp4l401ktimersoftd/320:45:163
4111993429,3cyclictest41-21ksoftirqd/321:17:273
4111993429,3cyclictest41-21ksoftirqd/320:07:563
4111993428,4cyclictest41-21ksoftirqd/323:59:033
4111993428,4cyclictest41-21ksoftirqd/323:35:323
4111993428,4cyclictest41-21ksoftirqd/322:10:073
4111993428,4cyclictest41-21ksoftirqd/321:39:103
4111993428,4cyclictest41-21ksoftirqd/321:26:063
4111993428,4cyclictest41-21ksoftirqd/319:57:293
4111993428,4cyclictest41-21ksoftirqd/300:39:143
4111993412,20cyclictest26744-21cat22:05:153
4111993412,20cyclictest26744-21cat22:05:153
4111993412,20cyclictest1848-21/usr/sbin/munin00:30:163
4111993410,21cyclictest32167-21ps21:10:203
4111993410,21cyclictest223-21systemd-journal23:46:123
4111993410,21cyclictest16563-21date22:50:003
411199340,3cyclictest29771-21df_abs00:20:143
4109993429,3cyclictest25-21ksoftirqd/119:37:361
4109993428,4cyclictest25-21ksoftirqd/123:12:391
4109993428,4cyclictest25-21ksoftirqd/122:32:441
4108993429,3cyclictest9-21ksoftirqd/022:55:110
4108993428,4cyclictest9-21ksoftirqd/023:51:250
4108993428,4cyclictest9-21ksoftirqd/023:45:470
4108993428,4cyclictest9-21ksoftirqd/023:15:510
4108993428,4cyclictest9-21ksoftirqd/022:24:160
4108993428,4cyclictest9-21ksoftirqd/021:23:300
4108993428,4cyclictest9-21ksoftirqd/020:47:040
4108993428,4cyclictest9-21ksoftirqd/019:46:470
4108993428,4cyclictest9-21ksoftirqd/019:37:000
4108993428,4cyclictest9-21ksoftirqd/000:37:180
411199334,3cyclictest0-21swapper/322:30:013
4111993328,3cyclictest41-21ksoftirqd/323:07:363
4111993327,4cyclictest41-21ksoftirqd/322:44:533
4111993327,4cyclictest41-21ksoftirqd/319:54:043
411199332,28cyclictest223-21systemd-journal22:55:003
4111993311,19cyclictest22768-21sed23:00:223
4111993310,20cyclictest6815-21/usr/sbin/munin19:15:263
4109993328,3cyclictest25-21ksoftirqd/120:44:031
4109993327,4cyclictest25-21ksoftirqd/123:09:351
4109993327,4cyclictest25-21ksoftirqd/121:26:211
4109993327,4cyclictest25-21ksoftirqd/120:49:221
4108993328,3cyclictest9-21ksoftirqd/022:41:220
4108993327,3cyclictest9-21ksoftirqd/021:12:400
411199329,3cyclictest27109-21df_abs00:15:153
4111993227,3cyclictest41-21ksoftirqd/322:35:123
4111993226,4cyclictest41-21ksoftirqd/323:40:133
4111993226,4cyclictest41-21ksoftirqd/320:56:543
4111993226,4cyclictest41-21ksoftirqd/319:43:533
411199320,3cyclictest13721-1kworker/3:1H23:30:013
411199320,29cyclictest10717-21sed21:30:263
4109993227,3cyclictest25-21ksoftirqd/122:10:111
4109993227,3cyclictest25-21ksoftirqd/120:20:341
4109993226,4cyclictest25-21ksoftirqd/122:46:161
4109993226,4cyclictest25-21ksoftirqd/122:16:591
4109993226,4cyclictest25-21ksoftirqd/121:02:181
4109993226,4cyclictest25-21ksoftirqd/100:18:211
4108993227,3cyclictest9-21ksoftirqd/022:10:560
4108993226,4cyclictest9-21ksoftirqd/023:26:380
4108993226,4cyclictest9-21ksoftirqd/022:54:490
4108993226,4cyclictest9-21ksoftirqd/022:26:090
4108993226,4cyclictest9-21ksoftirqd/022:01:200
4108993226,4cyclictest9-21ksoftirqd/021:57:010
4108993226,4cyclictest9-21ksoftirqd/020:57:070
4108993226,4cyclictest9-21ksoftirqd/020:07:170
4108993226,4cyclictest9-21ksoftirqd/019:23:040
4108993226,4cyclictest9-21ksoftirqd/019:14:460
4108993226,4cyclictest9-21ksoftirqd/019:14:460
4108993226,4cyclictest9-21ksoftirqd/000:05:340
4108993226,3cyclictest9-21ksoftirqd/000:10:510
4108993225,4cyclictest9-21ksoftirqd/019:51:310
2763523226,3sleep341-21ksoftirqd/323:10:213
138491320,2ptp4l411199cyclictest21:45:473
4111993126,3cyclictest41-21ksoftirqd/323:33:563
4111993126,3cyclictest41-21ksoftirqd/320:20:123
4111993126,3cyclictest41-21ksoftirqd/300:06:233
4109993126,3cyclictest25-21ksoftirqd/123:56:361
4109993126,3cyclictest25-21ksoftirqd/122:23:301
4109993125,4cyclictest25-21ksoftirqd/123:46:131
4109993125,4cyclictest25-21ksoftirqd/121:44:341
4109993125,4cyclictest25-21ksoftirqd/119:25:021
4108993126,3cyclictest9-21ksoftirqd/021:43:290
4108993126,3cyclictest9-21ksoftirqd/000:04:310
4108993125,4cyclictest9-21ksoftirqd/020:53:570
4108993125,4cyclictest9-21ksoftirqd/000:34:210
4108993125,4cyclictest9-21ksoftirqd/000:23:540
4108993125,4cyclictest9-21ksoftirqd/000:16:010
4108993125,3cyclictest9-21ksoftirqd/023:36:550
411199307,3cyclictest21595-21sort20:50:143
411199307,3cyclictest17004-21hwlatdetect20:40:173
411199306,3cyclictest15689-21mailstats19:30:233
411199304,2cyclictest0-21swapper/321:59:593
4111993025,3cyclictest41-21ksoftirqd/322:16:413
4111993025,3cyclictest41-21ksoftirqd/320:01:333
4111993025,3cyclictest41-21ksoftirqd/300:04:033
4109993025,3cyclictest25-21ksoftirqd/122:02:101
4109993024,4cyclictest25-21ksoftirqd/123:37:431
4109993024,4cyclictest25-21ksoftirqd/120:37:131
4109993024,4cyclictest25-21ksoftirqd/119:47:041
4108993024,4cyclictest9-21ksoftirqd/023:44:590
4108993024,4cyclictest9-21ksoftirqd/023:20:440
4108993024,4cyclictest9-21ksoftirqd/022:05:130
4108993024,4cyclictest9-21ksoftirqd/022:05:130
4108993024,4cyclictest9-21ksoftirqd/020:42:110
4108993024,4cyclictest9-21ksoftirqd/020:30:360
4108993024,4cyclictest9-21ksoftirqd/019:42:500
4108993024,3cyclictest9-21ksoftirqd/023:10:290
411199299,3cyclictest2947-21run-parts22:20:263
4109992924,3cyclictest25-21ksoftirqd/123:50:101
4109992924,3cyclictest25-21ksoftirqd/122:35:131
4109992924,3cyclictest25-21ksoftirqd/120:18:271
4109992924,3cyclictest25-21ksoftirqd/100:01:271
4109992923,4cyclictest25-21ksoftirqd/120:08:171
4108992924,3cyclictest9-21ksoftirqd/022:49:390
4108992924,3cyclictest9-21ksoftirqd/022:35:110
4108992924,3cyclictest9-21ksoftirqd/019:27:560
4108992923,4cyclictest9-21ksoftirqd/021:17:320
411199280,2cyclictest0-21swapper/323:50:153
4109992823,3cyclictest25-21ksoftirqd/120:30:111
4109992822,4cyclictest25-21ksoftirqd/122:40:131
4108992823,3cyclictest9-21ksoftirqd/019:59:300
4109992721,4cyclictest25-21ksoftirqd/121:33:381
4108992722,3cyclictest9-21ksoftirqd/023:55:110
4108992722,3cyclictest9-21ksoftirqd/021:50:010
4108992721,4cyclictest9-21ksoftirqd/000:25:510
4109992621,3cyclictest25-21ksoftirqd/122:25:121
4109992621,3cyclictest25-21ksoftirqd/119:11:131
4109992621,3cyclictest25-21ksoftirqd/119:11:131
4109992620,4cyclictest25-21ksoftirqd/120:55:561
410999260,17cyclictest0-21swapper/123:30:131
4109992521,3cyclictest25-21ksoftirqd/120:29:521
4109992520,3cyclictest25-21ksoftirqd/121:47:341
4108992520,3cyclictest9-21ksoftirqd/022:19:180
4109992419,3cyclictest25-21ksoftirqd/121:21:551
4109992418,4cyclictest25-21ksoftirqd/123:17:281
4109992418,3cyclictest25-21ksoftirqd/122:08:581
4109992418,3cyclictest25-21ksoftirqd/122:08:571
4108992419,3cyclictest9-21ksoftirqd/021:35:220
4108992418,3cyclictest9-21ksoftirqd/020:35:110
4109992317,4cyclictest25-21ksoftirqd/119:57:231
4109992317,4cyclictest25-21ksoftirqd/119:35:011
4109992317,4cyclictest25-21ksoftirqd/100:36:341
4109992115,4cyclictest25-21ksoftirqd/120:02:531
4108992116,3cyclictest9-21ksoftirqd/023:06:120
4109992014,4cyclictest25-21ksoftirqd/123:21:581
4109991910,6cyclictest18469-21grep22:50:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional