You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 04:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Mon Jul 13, 2026 00:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139491239170,23phc2sys0-21swapper/319:09:493
51962206171,24sleep00-21swapper/019:09:240
51932206173,22sleep20-21swapper/219:09:222
31182203170,22sleep10-21swapper/119:05:101
1394918969,10phc2sys0-21swapper/319:10:003
553699577,7cyclictest4444-21tr22:30:141
5535995727,8cyclictest9-21ksoftirqd/023:25:320
82202560,1sleep20-21swapper/219:15:142
553699567,6cyclictest13132-21cpuspeed_turbos23:55:131
553699551,15cyclictest20156-21cat00:10:001
553699550,11cyclictest534-21sed00:35:181
139391550,1ptp4l401ktimersoftd/300:05:593
553699544,10cyclictest5844-21apt-key23:40:011
553699544,10cyclictest5844-21apt-key23:40:011
553699540,11cyclictest25493-21sed23:10:291
553699535,7cyclictest25216-21cpuspeed_turbos00:20:141
553699533,6cyclictest0-21swapper/120:30:191
553699530,10cyclictest17568-21phc2sys22:55:231
139391530,1ptp4l401ktimersoftd/322:05:503
553699525,9cyclictest28427-21cat00:25:201
553699522,10cyclictest2518-21gnome-shell22:15:221
553699522,10cyclictest21757-21hwlatdetect20:50:161
553699521,10cyclictest13014-21cpuspeed_turbos21:40:131
139391520,1ptp4l401ktimersoftd/319:56:043
553699516,5cyclictest0-21swapper/121:00:101
553699515,6cyclictest13788-21latency_hist22:50:011
553699512,10cyclictest18171-21awk21:50:171
553699511,10cyclictest19868-21ls23:00:211
139391510,1ptp4l401ktimersoftd/323:50:343
553699503,9cyclictest8692-21sed19:15:191
553699501,10cyclictest16178-21cut22:55:001
553699500,11cyclictest6932-21phc2sys-jitter21:25:231
553699492,9cyclictest31151-21ptp4l-jitter00:30:251
553699492,9cyclictest25038-21latency_hist00:20:011
5536994841,4cyclictest26716-21cron19:54:591
553699482,18cyclictest837-21mailstats22:20:251
553699481,10cyclictest15285-21cat19:30:141
553699480,9cyclictest0-21swapper/120:57:581
553699480,16cyclictest1648-21sed20:10:011
553699472,9cyclictest2518-21gnome-shell21:47:581
553699472,10cyclictest22764-21sed22:00:131
553699471,11cyclictest4621-21fschecks_time20:15:171
553699471,10cyclictest24537-21grep19:50:001
553699470,18cyclictest27001-21sed23:15:191
553699470,16cyclictest9136-21cut23:45:191
553699470,11cyclictest791-21sed23:30:001
5537994611,4cyclictest33-21ksoftirqd/200:40:002
553699466,11cyclictest19434-21cat20:45:191
553699462,9cyclictest21988-21idleruntime-cro19:45:001
553699461,9cyclictest0-21swapper/121:59:581
553699461,5cyclictest0-21swapper/120:00:151
553799451,3cyclictest121rcu_preempt20:25:242
553699451,16cyclictest2038-21df_abs20:10:161
553699451,11cyclictest22622-21cat00:15:011
553699451,11cyclictest22622-21cat00:15:011
553699450,12cyclictest18224-21sed19:35:181
57898440,9rtkit-daemon0-21swapper/221:58:412
553699447,6cyclictest27538-21if_enp1s019:55:181
553699441,8cyclictest27601-21fschecks_time22:10:171
553699440,17cyclictest2790-21irqrtprio22:25:171
5535994410,4cyclictest9-21ksoftirqd/022:50:210
139391440,1ptp4l401ktimersoftd/321:55:373
5537994331,10cyclictest33-21ksoftirqd/221:10:172
553699435,6cyclictest309492sleep121:10:141
553699431,12cyclictest15671-21expr00:00:151
553699431,12cyclictest10857-21cstates23:50:131
5535994337,3cyclictest9-21ksoftirqd/020:05:000
553799426,8cyclictest33-21ksoftirqd/223:05:272
5537994210,7cyclictest33-21ksoftirqd/200:20:012
553699423,8cyclictest5857-21df19:10:141
553699421,16cyclictest1062-21ls23:30:141
139391420,1ptp4l401ktimersoftd/300:30:153
139391420,0ptp4l401ktimersoftd/323:15:153
5538994134,4cyclictest14421-21grep22:50:153
553799417,4cyclictest33-21ksoftirqd/222:40:002
553699411,8cyclictest9767-21sed22:40:181
553699411,8cyclictest9767-21sed22:40:181
553699411,8cyclictest10131-21meminfo20:25:211
553699411,7cyclictest9009-21irqstats21:30:201
553699411,7cyclictest25265-21hddtemp_smartct22:05:161
5537994035,3cyclictest33-21ksoftirqd/221:50:002
5537994035,3cyclictest33-21ksoftirqd/219:55:002
5537994020,12cyclictest33-21ksoftirqd/221:45:002
553699402,6cyclictest7305-21ps22:35:191
553699402,6cyclictest11353-21memory19:20:221
5535994034,3cyclictest9-21ksoftirqd/000:15:000
5535994034,3cyclictest9-21ksoftirqd/000:14:590
5537993935,2cyclictest33-21ksoftirqd/221:55:012
5537993935,2cyclictest33-21ksoftirqd/221:00:002
5537993933,3cyclictest33-21ksoftirqd/219:25:182
5537993931,6cyclictest33-21ksoftirqd/220:05:512
5537993910,6cyclictest33-21ksoftirqd/219:24:592
553799390,2cyclictest121rcu_preempt23:25:182
553599399,4cyclictest9-21ksoftirqd/020:50:270
553599396,10cyclictest9-21ksoftirqd/000:00:000
5535993934,3cyclictest9-21ksoftirqd/022:50:010
5535993933,3cyclictest9-21ksoftirqd/022:00:020
553799384,3cyclictest33-21ksoftirqd/222:00:142
5537993834,2cyclictest33-21ksoftirqd/200:25:012
5537993833,3cyclictest33-21ksoftirqd/220:15:282
5537993832,3cyclictest33-21ksoftirqd/200:00:212
553799380,7cyclictest33-21ksoftirqd/223:40:002
553699382,6cyclictest1318-21iostat_ios21:15:181
553699381,7cyclictest28999-21iostat_ios21:05:191
553599388,3cyclictest9-21ksoftirqd/023:35:150
553599387,7cyclictest9-21ksoftirqd/019:55:280
553599383,5cyclictest9-21ksoftirqd/019:24:590
5535993833,3cyclictest9-21ksoftirqd/019:45:000
5535993833,2cyclictest9-21ksoftirqd/019:10:200
553599383,2cyclictest121rcu_preempt20:25:010
5535993832,3cyclictest9-21ksoftirqd/020:55:150
5535993832,3cyclictest9-21ksoftirqd/000:15:180
553599380,3cyclictest121rcu_preempt00:00:250
553599380,2cyclictest121rcu_preempt21:00:120
5538993730,5cyclictest41-21ksoftirqd/322:59:283
5537993733,2cyclictest33-21ksoftirqd/220:25:012
5537993733,2cyclictest33-21ksoftirqd/219:50:002
5537993732,3cyclictest33-21ksoftirqd/223:45:002
5537993732,3cyclictest33-21ksoftirqd/223:45:002
5537993732,3cyclictest33-21ksoftirqd/220:35:192
5537993731,4cyclictest33-21ksoftirqd/223:45:192
5537993731,4cyclictest33-21ksoftirqd/221:31:372
5537993731,3cyclictest33-21ksoftirqd/223:00:012
5537993727,8cyclictest33-21ksoftirqd/220:00:252
5537993723,11cyclictest33-21ksoftirqd/222:45:122
553799371,3cyclictest121rcu_preempt21:20:002
5536993731,4cyclictest25-21ksoftirqd/120:42:391
553699370,10cyclictest3794-21irqrtprio21:20:181
553599375,4cyclictest9-21ksoftirqd/021:45:150
5535993733,2cyclictest9-21ksoftirqd/023:05:000
5535993733,2cyclictest9-21ksoftirqd/022:35:140
5535993733,2cyclictest9-21ksoftirqd/022:30:010
5535993732,3cyclictest9-21ksoftirqd/023:00:010
5535993732,3cyclictest9-21ksoftirqd/021:20:000
5535993732,2cyclictest9-21ksoftirqd/021:35:130
5535993731,3cyclictest9-21ksoftirqd/021:10:010
5535993731,3cyclictest9-21ksoftirqd/020:10:160
5535993731,3cyclictest9-21ksoftirqd/020:05:140
5535993731,3cyclictest9-21ksoftirqd/000:35:190
5535993730,4cyclictest9-21ksoftirqd/020:18:100
553599372,3cyclictest121rcu_preempt21:41:580
5535993722,4cyclictest9-21ksoftirqd/000:05:130
5538993630,4cyclictest41-21ksoftirqd/320:55:523
5538993630,3cyclictest41-21ksoftirqd/320:05:013
5538993628,5cyclictest41-21ksoftirqd/300:26:593
553799366,7cyclictest33-21ksoftirqd/219:35:132
5537993632,3cyclictest33-21ksoftirqd/223:25:012
5537993632,3cyclictest33-21ksoftirqd/222:20:002
5537993632,2cyclictest33-21ksoftirqd/220:40:142
5537993631,3cyclictest33-21ksoftirqd/222:25:112
5537993631,3cyclictest33-21ksoftirqd/222:25:002
5537993631,3cyclictest33-21ksoftirqd/219:40:272
5537993631,3cyclictest33-21ksoftirqd/219:10:122
5537993631,2cyclictest33-21ksoftirqd/221:25:002
5537993630,4cyclictest33-21ksoftirqd/221:06:112
5537993630,3cyclictest33-21ksoftirqd/220:10:292
5535993632,3cyclictest9-21ksoftirqd/000:20:280
5535993631,3cyclictest9-21ksoftirqd/023:30:160
5535993631,2cyclictest9-21ksoftirqd/019:25:180
5535993630,4cyclictest9-21ksoftirqd/020:38:000
5535993630,3cyclictest9-21ksoftirqd/023:50:240
5535993630,3cyclictest9-21ksoftirqd/023:05:140
5535993630,3cyclictest9-21ksoftirqd/022:45:010
5535993630,3cyclictest9-21ksoftirqd/022:45:000
5535993630,3cyclictest9-21ksoftirqd/022:30:250
5535993630,3cyclictest9-21ksoftirqd/022:00:130
5535993630,3cyclictest9-21ksoftirqd/020:20:150
139391360,1ptp4l401ktimersoftd/322:35:183
5538993530,3cyclictest41-21ksoftirqd/320:49:533
5538993529,4cyclictest41-21ksoftirqd/322:26:303
5538993529,4cyclictest41-21ksoftirqd/321:52:483
5538993529,4cyclictest41-21ksoftirqd/321:17:343
5538993529,4cyclictest41-21ksoftirqd/320:36:273
5538993529,4cyclictest41-21ksoftirqd/320:06:553
5538993529,4cyclictest41-21ksoftirqd/319:46:403
5538993529,4cyclictest41-21ksoftirqd/319:34:083
5537993532,2cyclictest33-21ksoftirqd/219:30:182
5537993530,3cyclictest33-21ksoftirqd/222:10:142
5537993530,3cyclictest33-21ksoftirqd/221:35:142
5537993530,3cyclictest33-21ksoftirqd/221:28:162
5537993529,4cyclictest33-21ksoftirqd/223:15:362
5537993529,3cyclictest33-21ksoftirqd/200:05:162
553799352,3cyclictest33-21ksoftirqd/222:45:002
553799352,3cyclictest33-21ksoftirqd/222:45:002
553599355,3cyclictest9-21ksoftirqd/019:45:190
5535993531,2cyclictest9-21ksoftirqd/022:10:000
5535993531,2cyclictest9-21ksoftirqd/021:10:250
5535993531,2cyclictest9-21ksoftirqd/000:35:000
5535993530,3cyclictest9-21ksoftirqd/023:10:150
5535993530,3cyclictest9-21ksoftirqd/022:20:000
5535993530,3cyclictest9-21ksoftirqd/020:30:190
5535993530,3cyclictest9-21ksoftirqd/019:50:270
5535993530,3cyclictest9-21ksoftirqd/000:30:000
5535993529,4cyclictest9-21ksoftirqd/019:17:480
5535993529,3cyclictest9-21ksoftirqd/023:45:140
5535993529,3cyclictest9-21ksoftirqd/022:20:140
5535993529,3cyclictest9-21ksoftirqd/019:30:180
553599350,4cyclictest9-21ksoftirqd/020:40:190
553599350,2cyclictest121rcu_preempt22:10:170
139391350,0ptp4l401ktimersoftd/300:20:213
5538993430,3cyclictest41-21ksoftirqd/322:15:013
5538993429,3cyclictest41-21ksoftirqd/320:30:113
5538993428,4cyclictest41-21ksoftirqd/323:37:273
5538993428,4cyclictest41-21ksoftirqd/322:34:453
553799343,8cyclictest33-21ksoftirqd/220:55:002
5537993428,3cyclictest33-21ksoftirqd/223:55:142
5537993428,3cyclictest33-21ksoftirqd/223:30:152
553699342,4cyclictest0-21swapper/123:08:351
553699341,17cyclictest11016-21if_enp1s021:35:171
553599346,2cyclictest9-21ksoftirqd/019:35:130
5535993429,3cyclictest9-21ksoftirqd/023:40:200
5535993429,3cyclictest9-21ksoftirqd/023:40:200
5535993429,3cyclictest9-21ksoftirqd/023:15:280
5535993429,3cyclictest9-21ksoftirqd/021:20:180
5535993428,3cyclictest9-21ksoftirqd/023:20:150
5535993428,3cyclictest9-21ksoftirqd/021:30:010
139391340,11ptp4l401ktimersoftd/323:05:003
139391340,0ptp4l401ktimersoftd/321:46:553
5538993328,3cyclictest41-21ksoftirqd/323:55:133
5538993327,4cyclictest41-21ksoftirqd/322:49:013
5538993327,4cyclictest41-21ksoftirqd/321:24:243
553799334,7cyclictest33-21ksoftirqd/223:00:132
553799334,4cyclictest121rcu_preempt20:30:252
5537993330,2cyclictest33-21ksoftirqd/220:49:082
5537993328,3cyclictest33-21ksoftirqd/223:15:002
5537993328,3cyclictest33-21ksoftirqd/221:05:012
5537993327,3cyclictest33-21ksoftirqd/222:50:192
553799331,7cyclictest33-21ksoftirqd/222:05:252
553799330,8cyclictest33-21ksoftirqd/200:30:002
5536993326,4cyclictest16162-21cron20:40:001
5535993330,2cyclictest9-21ksoftirqd/020:50:000
5535993329,2cyclictest9-21ksoftirqd/021:30:260
139391330,0ptp4l401ktimersoftd/320:15:203
5538993226,4cyclictest41-21ksoftirqd/323:32:223
5538993226,4cyclictest41-21ksoftirqd/323:01:413
5538993226,4cyclictest41-21ksoftirqd/320:28:083
553799324,3cyclictest121rcu_preempt00:10:162
553799324,3cyclictest121rcu_preempt00:10:152
5537993228,3cyclictest33-21ksoftirqd/223:50:132
553799320,4cyclictest33-21ksoftirqd/222:30:282
5536993227,3cyclictest25-21ksoftirqd/119:29:581
5535993226,3cyclictest9-21ksoftirqd/021:50:140
5538993127,2cyclictest41-21ksoftirqd/320:22:073
5538993126,3cyclictest41-21ksoftirqd/320:43:533
5538993126,3cyclictest41-21ksoftirqd/319:54:423
5538993126,3cyclictest41-21ksoftirqd/300:12:183
5538993126,3cyclictest41-21ksoftirqd/300:12:183
5538993125,4cyclictest41-21ksoftirqd/323:24:193
5538993125,4cyclictest41-21ksoftirqd/322:18:563
5538993125,4cyclictest41-21ksoftirqd/321:33:353
5538993125,4cyclictest41-21ksoftirqd/321:03:543
5538993125,4cyclictest41-21ksoftirqd/320:54:153
5538993125,4cyclictest41-21ksoftirqd/319:41:023
5537993127,2cyclictest33-21ksoftirqd/219:55:272
5537993125,4cyclictest33-21ksoftirqd/200:33:542
5536993126,3cyclictest25-21ksoftirqd/123:21:291
5538993025,3cyclictest41-21ksoftirqd/321:14:473
5538993025,3cyclictest41-21ksoftirqd/321:07:113
5538993025,3cyclictest14805-21cron19:30:013
5538993024,4cyclictest41-21ksoftirqd/321:43:223
139391300,0ptp4l401ktimersoftd/323:29:323
139391300,0ptp4l401ktimersoftd/322:04:543
139391300,0ptp4l401ktimersoftd/319:35:163
139391300,0ptp4l401ktimersoftd/319:20:093
5538992925,3cyclictest41-21ksoftirqd/319:19:093
5538992924,3cyclictest41-21ksoftirqd/323:41:363
5538992924,3cyclictest41-21ksoftirqd/323:41:363
5538992924,3cyclictest41-21ksoftirqd/321:27:333
5538992924,3cyclictest41-21ksoftirqd/300:19:313
5538992923,4cyclictest41-21ksoftirqd/300:35:353
5538992923,4cyclictest41-21ksoftirqd/300:00:383
5538992923,3cyclictest9727-21grep22:40:183
5538992923,3cyclictest9727-21grep22:40:183
139391290,8ptp4l401ktimersoftd/323:12:093
5538992823,3cyclictest41-21ksoftirqd/320:10:193
5538992822,4cyclictest41-21ksoftirqd/322:21:373
5538992721,4cyclictest41-21ksoftirqd/321:37:143
5536992722,3cyclictest25-21ksoftirqd/120:21:401
139391270,0ptp4l401ktimersoftd/323:45:143
5536992620,4cyclictest25-21ksoftirqd/123:38:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional