You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 11:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot2.osadl.org (updated Sat Dec 06, 2025 00:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3065123280,56sleep30-21swapper/319:07:483
2290222260,3sleep122936-21sh19:08:371
1792522030,11sleep00-21swapper/019:05:160
224022201167,23sleep20-21swapper/219:08:362
176342590,3sleep017629-21sort19:10:230
176342590,3sleep017629-21sort19:10:230
133291590,10getstats7401-21ls00:00:223
18632540,2sleep00-21swapper/022:40:280
136591540,1ptp4l401ktimersoftd/322:12:413
103352490,3sleep10-21swapper/119:35:241
2702994619,3cyclictest33-21ksoftirqd/219:10:402
2702994619,3cyclictest33-21ksoftirqd/219:10:402
270099450,2cyclictest1307-21runrttasks00:06:340
2700994412,18cyclictest7257-21seq20:39:140
136591440,0ptp4l401ktimersoftd/300:09:413
270099436,21cyclictest11073-21seq19:39:190
270099426,20cyclictest0-21swapper/019:15:200
136591420,0ptp4l401ktimersoftd/322:08:283
136591420,0ptp4l401ktimersoftd/319:50:073
136591410,0ptp4l401ktimersoftd/322:48:003
136591410,0ptp4l401ktimersoftd/319:45:233
270099401,2cyclictest0-21swapper/019:49:510
136591400,7ptp4l401ktimersoftd/323:13:383
136591400,0ptp4l401ktimersoftd/321:39:103
136591400,0ptp4l401ktimersoftd/300:35:283
133291400,3getstats0-21swapper/322:30:013
270299398,10cyclictest33-21ksoftirqd/219:20:192
270199395,20cyclictest14796-21cat20:55:001
270199390,4cyclictest10561-21seq00:07:101
270099398,17cyclictest11301-21/usr/sbin/munin21:55:220
270099390,3cyclictest20919-21seq20:00:020
270299384,4cyclictest33-21ksoftirqd/220:00:162
270299383,3cyclictest33-21ksoftirqd/200:35:282
270299381,3cyclictest121rcu_preempt22:40:002
2702993812,4cyclictest33-21ksoftirqd/221:00:212
270199381,2cyclictest0-21swapper/100:10:471
136591380,0ptp4l401ktimersoftd/322:20:243
133291380,2getstats0-21swapper/322:00:013
270299377,3cyclictest33-21ksoftirqd/222:20:252
270299377,2cyclictest33-21ksoftirqd/220:20:222
270299375,3cyclictest33-21ksoftirqd/222:10:192
270299373,7cyclictest33-21ksoftirqd/222:40:192
270299373,3cyclictest33-21ksoftirqd/220:50:222
270299373,2cyclictest33-21ksoftirqd/222:50:242
270299373,2cyclictest33-21ksoftirqd/222:25:202
2702993725,10cyclictest33-21ksoftirqd/223:50:192
2702993711,8cyclictest33-21ksoftirqd/220:15:192
270199376,29cyclictest13447-21kworker/1:020:04:201
176452370,8sleep0270099cyclictest22:05:260
133291370,1getstats0-21swapper/321:15:013
133291370,1getstats0-21swapper/321:15:013
270299362,3cyclictest33-21ksoftirqd/219:50:182
270299361,3cyclictest33-21ksoftirqd/219:30:272
2702993610,3cyclictest33-21ksoftirqd/222:55:262
270199366,29cyclictest3930-21kworker/1:121:48:401
270199366,18cyclictest9876-21kworker/1:023:16:241
133291360,1getstats3286-1kworker/3:0H20:10:003
270299358,3cyclictest33-21ksoftirqd/223:25:232
270299357,4cyclictest33-21ksoftirqd/221:25:002
270299354,5cyclictest33-21ksoftirqd/220:35:142
2702993524,9cyclictest33-21ksoftirqd/220:45:132
2702993523,10cyclictest33-21ksoftirqd/219:25:152
270199355,29cyclictest13447-21kworker/1:020:23:291
270099358,23cyclictest226-21systemd-journal22:55:000
270299344,4cyclictest33-21ksoftirqd/219:45:172
2702993428,3cyclictest33-21ksoftirqd/223:20:182
2702993428,3cyclictest33-21ksoftirqd/222:30:162
270299341,6cyclictest33-21ksoftirqd/220:15:012
270299341,6cyclictest33-21ksoftirqd/220:15:012
2702993410,3cyclictest33-21ksoftirqd/223:45:152
270199347,26cyclictest28504-21kworker/1:123:57:051
270199343,30cyclictest10957-21kworker/1:200:27:411
2701993428,4cyclictest25-21ksoftirqd/123:26:271
2701993428,4cyclictest25-21ksoftirqd/122:58:401
2701993428,4cyclictest25-21ksoftirqd/121:03:011
270199341,3cyclictest4565-21seq22:45:551
270199341,32cyclictest10957-21kworker/1:200:15:371
270199340,3cyclictest2378-21runrttasks22:43:141
136591340,29ptp4l35692irq/125-enp1s0-23:56:163
2706993327,4cyclictest41-21ksoftirqd/323:22:043
2706993327,4cyclictest41-21ksoftirqd/322:41:133
270299338,4cyclictest33-21ksoftirqd/223:05:012
270299336,6cyclictest33-21ksoftirqd/200:20:252
270299333,8cyclictest33-21ksoftirqd/220:30:222
270299333,4cyclictest33-21ksoftirqd/200:05:312
2702993329,2cyclictest33-21ksoftirqd/223:20:012
2702993329,2cyclictest33-21ksoftirqd/222:00:132
2702993328,3cyclictest33-21ksoftirqd/219:15:132
270299332,3cyclictest121rcu_preempt21:15:202
2702993321,9cyclictest33-21ksoftirqd/219:35:252
270299331,3cyclictest33-21ksoftirqd/223:30:172
2702993310,3cyclictest33-21ksoftirqd/221:50:252
2702993310,3cyclictest33-21ksoftirqd/221:50:252
270299330,7cyclictest121rcu_preempt19:55:182
270199336,26cyclictest12952-21kworker/1:022:02:331
270199335,27cyclictest12952-21kworker/1:022:09:251
270199335,18cyclictest902-21kworker/1:119:28:451
270199333,29cyclictest9876-21kworker/1:023:10:521
270199333,29cyclictest12952-21kworker/1:022:18:571
2701993327,4cyclictest25-21ksoftirqd/120:42:241
2701993327,4cyclictest25-21ksoftirqd/120:42:241
2701993327,4cyclictest25-21ksoftirqd/119:57:501
270199332,20cyclictest9876-21kworker/1:023:31:211
270099333,24cyclictest2259-21gnome-shell23:59:580
2700993327,4cyclictest9-21ksoftirqd/023:15:120
2700993327,4cyclictest9-21ksoftirqd/020:17:030
2700993327,4cyclictest9-21ksoftirqd/000:30:330
1366913327,3phc2sys41-21ksoftirqd/323:15:193
136591330,0ptp4l401ktimersoftd/322:35:183
270299327,3cyclictest33-21ksoftirqd/220:25:292
270299327,3cyclictest33-21ksoftirqd/200:25:252
270299326,3cyclictest33-21ksoftirqd/221:55:162
270299326,2cyclictest33-21ksoftirqd/223:00:192
270299325,6cyclictest33-21ksoftirqd/222:45:162
270299324,5cyclictest33-21ksoftirqd/200:00:182
270299323,4cyclictest33-21ksoftirqd/221:44:092
2702993228,2cyclictest33-21ksoftirqd/223:35:162
2702993228,2cyclictest33-21ksoftirqd/200:15:012
2702993227,3cyclictest33-21ksoftirqd/221:45:132
2702993227,2cyclictest33-21ksoftirqd/221:39:532
2702993226,4cyclictest33-21ksoftirqd/223:44:412
270299322,3cyclictest33-21ksoftirqd/221:30:242
270299322,3cyclictest33-21ksoftirqd/200:15:222
270299322,2cyclictest121rcu_preempt23:55:162
270199327,22cyclictest7647-21tee19:10:091
270199327,22cyclictest7647-21tee19:10:081
270199324,26cyclictest9876-21kworker/1:023:07:331
270199324,18cyclictest13447-21kworker/1:020:09:081
2701993226,4cyclictest25-21ksoftirqd/120:56:431
270199322,20cyclictest13447-21kworker/1:019:52:321
270199322,19cyclictest9876-21kworker/1:023:23:401
2701993213,16cyclictest28058-21grep20:15:141
270199320,31cyclictest10957-21kworker/1:200:22:531
2700993226,4cyclictest9-21ksoftirqd/021:38:110
2700993226,4cyclictest9-21ksoftirqd/020:29:380
2700993226,4cyclictest9-21ksoftirqd/019:43:130
2700993225,5cyclictest9-21ksoftirqd/021:25:390
270099320,3cyclictest25105-21seq00:38:350
136591320,1ptp4l391rcuc/323:00:013
2706993125,4cyclictest41-21ksoftirqd/323:43:473
2706993125,4cyclictest41-21ksoftirqd/323:33:193
2706993125,4cyclictest41-21ksoftirqd/321:51:223
2706993125,4cyclictest41-21ksoftirqd/321:51:213
2706993125,4cyclictest41-21ksoftirqd/320:51:563
2702993127,2cyclictest33-21ksoftirqd/223:15:002
2702993127,2cyclictest33-21ksoftirqd/221:00:002
2702993127,2cyclictest33-21ksoftirqd/220:05:132
2702993126,2cyclictest1307-21runrttasks22:07:072
2702993125,4cyclictest33-21ksoftirqd/221:28:332
2702993125,3cyclictest33-21ksoftirqd/220:40:162
2702993125,3cyclictest33-21ksoftirqd/220:40:162
270299312,2cyclictest121rcu_preempt22:15:312
270299311,5cyclictest33-21ksoftirqd/219:40:142
270299310,6cyclictest33-21ksoftirqd/221:05:152
2701993126,3cyclictest25-21ksoftirqd/119:20:001
2701993125,4cyclictest25-21ksoftirqd/100:32:101
2701993124,5cyclictest25-21ksoftirqd/122:35:091
270199312,27cyclictest902-21kworker/1:119:34:171
270199312,27cyclictest28504-21kworker/1:123:45:021
270199312,27cyclictest23240-21kworker/1:222:25:271
270199311,29cyclictest28504-21kworker/1:123:42:411
270199310,4cyclictest1530-21cpuspeed_turbos19:20:131
2700993126,3cyclictest9-21ksoftirqd/023:31:540
2700993126,3cyclictest9-21ksoftirqd/021:32:010
2700993125,4cyclictest9-21ksoftirqd/023:44:310
2700993125,4cyclictest9-21ksoftirqd/022:45:100
2700993125,4cyclictest9-21ksoftirqd/022:10:320
2700993125,4cyclictest9-21ksoftirqd/020:57:470
2700993125,4cyclictest9-21ksoftirqd/020:09:490
2700993124,4cyclictest9-21ksoftirqd/020:23:360
2700993113,16cyclictest26046-21tune2fs22:25:190
270099310,4cyclictest15001-21tr23:10:130
2706993025,4cyclictest41-21ksoftirqd/320:38:403
2706993025,3cyclictest41-21ksoftirqd/321:09:423
2706993025,3cyclictest41-21ksoftirqd/319:10:143
2706993025,3cyclictest41-21ksoftirqd/319:10:133
2706993024,4cyclictest41-21ksoftirqd/321:01:223
2706993024,4cyclictest41-21ksoftirqd/320:26:173
2706993024,4cyclictest41-21ksoftirqd/319:30:453
2702993025,3cyclictest33-21ksoftirqd/200:32:462
2702993023,4cyclictest33-21ksoftirqd/221:10:122
2702993023,4cyclictest33-21ksoftirqd/221:10:112
270199308,19cyclictest2272-21irqrtprio23:50:191
270199307,20cyclictest0-21swapper/121:25:241
2701993024,4cyclictest25-21ksoftirqd/120:14:111
2701993024,4cyclictest25-21ksoftirqd/120:14:111
2701993024,4cyclictest25-21ksoftirqd/100:00:451
270199302,17cyclictest13447-21kworker/1:019:44:371
2701993015,12cyclictest5742-21timerandwakeup21:40:241
270199300,19cyclictest12952-21kworker/1:022:11:531
270099309,19cyclictest22989-21latency_hist22:20:000
270099309,18cyclictest625-21cat23:45:270
2700993025,3cyclictest9-21ksoftirqd/023:29:040
2700993025,3cyclictest9-21ksoftirqd/000:17:130
2700993024,4cyclictest9-21ksoftirqd/023:03:430
2700993024,4cyclictest9-21ksoftirqd/022:57:210
2700993024,4cyclictest9-21ksoftirqd/021:07:260
2700993024,4cyclictest9-21ksoftirqd/020:51:210
2700993013,15cyclictest7583-21cat21:45:200
2700993013,14cyclictest4327-21wc21:40:120
2700993012,15cyclictest7780-21which19:30:230
136591300,0ptp4l401ktimersoftd/321:30:583
110022300,2sleep30-21swapper/320:45:183
2706992924,3cyclictest41-21ksoftirqd/320:55:123
2706992924,3cyclictest41-21ksoftirqd/319:24:003
2706992924,3cyclictest41-21ksoftirqd/300:31:333
2706992923,4cyclictest41-21ksoftirqd/323:39:173
2706992923,4cyclictest41-21ksoftirqd/321:21:013
2706992923,4cyclictest41-21ksoftirqd/320:12:093
2706992923,4cyclictest41-21ksoftirqd/320:12:093
2706992923,4cyclictest41-21ksoftirqd/300:20:533
2706992923,4cyclictest41-21ksoftirqd/300:17:363
2701992924,3cyclictest25-21ksoftirqd/121:33:101
2701992924,3cyclictest25-21ksoftirqd/120:36:131
270199292,23cyclictest0-21swapper/121:50:111
270199292,23cyclictest0-21swapper/121:50:111
270199291,4cyclictest14238-21grep19:45:171
270199291,27cyclictest23240-21kworker/1:222:22:571
270199290,4cyclictest10102-21expr23:00:141
270199290,3cyclictest26807-21cpu23:35:131
270099298,19cyclictest19684-21grep19:55:210
270099297,19cyclictest4381-21grep20:30:280
270099297,19cyclictest19562-21date21:05:000
2700992924,3cyclictest9-21ksoftirqd/020:14:050
2700992924,3cyclictest9-21ksoftirqd/020:14:050
2700992923,4cyclictest9-21ksoftirqd/023:08:370
2700992923,4cyclictest9-21ksoftirqd/019:51:040
2700992923,4cyclictest9-21ksoftirqd/019:27:530
270099291,5cyclictest24626-21cpuspeed_turbos21:15:140
270099291,4cyclictest32108-21awk22:35:280
270099291,4cyclictest20497-21cron00:30:000
270099291,4cyclictest10611-21grep20:45:160
2700992910,16cyclictest2920-21grep23:50:230
270099290,4cyclictest22667-21if_enp4s021:10:180
270099290,4cyclictest22667-21if_enp4s021:10:170
270099290,3cyclictest285492chrt23:35:490
136591290,0ptp4l401ktimersoftd/323:46:493
2706992823,3cyclictest41-21ksoftirqd/321:40:163
2706992823,3cyclictest41-21ksoftirqd/319:16:243
2706992822,4cyclictest41-21ksoftirqd/319:26:483
270199287,18cyclictest4083-21cut21:39:591
270199287,18cyclictest11435-21cat20:45:221
270199286,19cyclictest4380-21cat20:30:291
2701992822,4cyclictest25-21ksoftirqd/121:58:581
270199281,4cyclictest24865-21vmstat00:35:281
270199281,3cyclictest1047-21sed20:25:211
270199280,5cyclictest26982-21grep21:20:141
270099286,19cyclictest8506-21latency_hist00:05:000
2700992823,3cyclictest9-21ksoftirqd/022:04:430
2700992823,3cyclictest9-21ksoftirqd/000:22:540
270099281,4cyclictest27314-21tune2fs21:20:160
136591280,1ptp4l401ktimersoftd/320:02:513
136591280,0ptp4l401ktimersoftd/322:54:123
2706992722,3cyclictest41-21ksoftirqd/320:43:543
2706992722,3cyclictest41-21ksoftirqd/320:43:543
2706992722,3cyclictest41-21ksoftirqd/319:36:413
2706992721,4cyclictest41-21ksoftirqd/300:13:593
270199279,15cyclictest30116-21latency_hist22:35:001
270199275,20cyclictest23240-21kworker/1:222:50:151
270199271,4cyclictest24624-21cpuspeed_turbos21:15:151
270199271,4cyclictest20373-21ps21:05:191
270199270,5cyclictest23441-21awk21:10:241
270199270,5cyclictest23441-21awk21:10:241
2700992722,3cyclictest9-21ksoftirqd/022:20:010
270099271,4cyclictest11596-21df00:10:150
270099271,3cyclictest9108-21cat20:40:270
270099271,3cyclictest9108-21cat20:40:270
270099271,3cyclictest30306-21latency_hist22:35:000
270099270,5cyclictest20907-21ps23:20:260
270099270,4cyclictest9442-21fschecks_time21:50:160
270099270,4cyclictest9442-21fschecks_time21:50:160
136591270,1ptp4l401ktimersoftd/321:16:033
2706992620,4cyclictest41-21ksoftirqd/321:47:403
270099264,3cyclictest1792-21df_abs19:20:140
2706992521,2cyclictest41-21ksoftirqd/300:26:363
2706992520,3cyclictest41-21ksoftirqd/321:26:103
2706992520,3cyclictest41-21ksoftirqd/319:42:203
2706992519,4cyclictest41-21ksoftirqd/322:56:413
2706992519,3cyclictest41-21ksoftirqd/320:20:143
136591250,0ptp4l401ktimersoftd/320:32:093
2706992420,2cyclictest41-21ksoftirqd/320:19:103
2706992419,3cyclictest41-21ksoftirqd/322:15:323
2706992419,3cyclictest41-21ksoftirqd/319:57:103
2706992418,4cyclictest41-21ksoftirqd/322:00:133
136591230,0ptp4l401ktimersoftd/323:50:203
136591230,0ptp4l401ktimersoftd/323:25:193
136591230,0ptp4l401ktimersoftd/323:09:573
136591230,0ptp4l401ktimersoftd/322:30:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional