You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 06:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Mon Dec 29, 2025 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134922204170,22sleep30-21swapper/319:06:163
134542201166,23sleep10-21swapper/119:05:461
134962200168,21sleep20-21swapper/219:06:192
134842199165,22sleep00-21swapper/019:06:090
1184921410,5sleep21408299cyclictest22:20:112
1385918262,11phc2sys0-21swapper/319:10:003
1408299639,16cyclictest14679-21df_abs22:25:152
1408299638,11cyclictest25335-21irqrtprio19:30:182
1408299637,11cyclictest5162-21cut23:10:192
1408299618,18cyclictest19228-21grep22:35:122
1408299607,18cyclictest2315-21gnome-shell21:25:272
1408299607,11cyclictest1319-21snmpd00:21:112
1408299597,17cyclictest1319-21snmpd20:30:422
1408299597,10cyclictest4312-21/usr/sbin/munin21:00:302
1408299597,10cyclictest4180-21latency_hist23:09:592
1408299589,9cyclictest9565-21expr20:05:132
1408299585,18cyclictest0-21swapper/223:16:152
1408299585,10cyclictest29109-21latency_hist19:39:592
1408299584,18cyclictest0-21swapper/221:50:262
14082995810,11cyclictest20662-21sensors23:40:242
1408299576,11cyclictest30893-21cat22:55:302
1408299576,11cyclictest11825-21awk23:25:142
1408299574,11cyclictest18221-21switchtime23:35:252
1408299566,11cyclictest6824-21cat20:00:012
1408299564,11cyclictest23000-21latency19:25:192
1408299556,16cyclictest25490-21cat22:45:212
1408299546,11cyclictest7011-21cat21:05:172
1408299545,10cyclictest3398-21mailstats19:50:252
14080995424,16cyclictest9-21ksoftirqd/000:00:010
14080995417,2cyclictest121rcu_preempt19:45:280
138491540,1ptp4l401ktimersoftd/300:05:313
1408299536,16cyclictest10343-21meminfo21:10:212
1408299536,11cyclictest6204-21sshd00:16:262
1408299535,11cyclictest32331-21cut21:55:202
1408299526,17cyclictest32424-21cut00:05:202
1408299524,10cyclictest0-21swapper/222:30:182
1408099528,8cyclictest9-21ksoftirqd/021:10:140
14080995220,4cyclictest9-21ksoftirqd/022:20:190
14080995216,6cyclictest9-21ksoftirqd/020:39:590
14080995215,5cyclictest9-21ksoftirqd/020:35:000
1408299504,16cyclictest0-21swapper/222:40:152
1408299504,10cyclictest0-21swapper/219:10:152
14080995018,5cyclictest9-21ksoftirqd/021:20:270
14080995015,6cyclictest9-21ksoftirqd/021:35:000
14083994920,3cyclictest41-21ksoftirqd/319:30:253
14080994917,6cyclictest9-21ksoftirqd/023:20:150
1408299486,8cyclictest718-21ps19:45:242
1408299484,7cyclictest30051-21irqstats00:00:192
14080994819,4cyclictest9-21ksoftirqd/023:45:010
14080994818,4cyclictest9-21ksoftirqd/000:35:010
14080994817,5cyclictest9-21ksoftirqd/019:15:000
14080994817,3cyclictest9-21ksoftirqd/020:15:200
14080994816,6cyclictest9-21ksoftirqd/022:40:160
14080994816,6cyclictest9-21ksoftirqd/022:05:160
14080994816,5cyclictest9-21ksoftirqd/022:15:140
14080994815,6cyclictest9-21ksoftirqd/022:00:220
14080994813,5cyclictest9-21ksoftirqd/022:30:180
14080994810,5cyclictest9-21ksoftirqd/022:35:130
1408299475,8cyclictest7583-21iostat_ios20:00:172
1408099479,6cyclictest9-21ksoftirqd/023:00:220
14080994719,6cyclictest9-21ksoftirqd/021:55:010
14080994719,10cyclictest9-21ksoftirqd/019:15:250
14080994718,5cyclictest9-21ksoftirqd/021:00:180
14080994715,5cyclictest9-21ksoftirqd/023:45:230
14080994713,5cyclictest9-21ksoftirqd/019:20:010
138491470,1ptp4l0-21swapper/320:04:123
1408299467,15cyclictest12883-21memory20:10:222
14080994622,8cyclictest9-21ksoftirqd/022:14:590
14080994617,3cyclictest9-21ksoftirqd/022:45:270
14080994614,5cyclictest9-21ksoftirqd/023:10:190
14080994613,6cyclictest9-21ksoftirqd/023:30:280
14080994613,5cyclictest9-21ksoftirqd/022:25:140
14080994611,6cyclictest9-21ksoftirqd/020:40:170
1408299457,9cyclictest27187-21perl20:40:162
1408299457,10cyclictest8055-21sort22:10:232
1408299456,7cyclictest31813-21apt23:00:152
1408299454,11cyclictest9980-21kworker/u8:219:20:122
1408299453,6cyclictest9353-21/usr/sbin/munin22:15:232
1408099458,5cyclictest9-21ksoftirqd/023:25:190
1408099454,3cyclictest9-21ksoftirqd/020:09:590
14080994527,5cyclictest9-21ksoftirqd/000:15:240
14080994520,3cyclictest9-21ksoftirqd/022:55:240
14080994517,4cyclictest9-21ksoftirqd/019:30:190
14080994514,4cyclictest9-21ksoftirqd/000:00:240
14080994513,7cyclictest9-21ksoftirqd/000:20:290
14080994512,4cyclictest9-21ksoftirqd/021:40:180
14080994511,6cyclictest9-21ksoftirqd/021:45:190
14080994511,5cyclictest9-21ksoftirqd/023:35:140
14080994511,5cyclictest9-21ksoftirqd/019:25:140
14080994510,4cyclictest9-21ksoftirqd/020:10:150
138491450,0ptp4l401ktimersoftd/320:55:373
14083994413,4cyclictest41-21ksoftirqd/323:35:153
14083994411,4cyclictest41-21ksoftirqd/322:20:183
1408099449,6cyclictest9-21ksoftirqd/019:55:150
1408099447,5cyclictest9-21ksoftirqd/023:15:160
14080994415,8cyclictest9-21ksoftirqd/020:45:160
14080994413,6cyclictest9-21ksoftirqd/020:50:130
14080994413,3cyclictest9-21ksoftirqd/000:25:260
14080994412,5cyclictest9-21ksoftirqd/019:35:170
14080994411,6cyclictest9-21ksoftirqd/023:05:140
14080994411,5cyclictest9-21ksoftirqd/000:35:160
14080994411,5cyclictest9-21ksoftirqd/000:05:280
14080994410,8cyclictest9-21ksoftirqd/021:15:260
138491440,0ptp4l401ktimersoftd/320:05:463
14083994329,12cyclictest41-21ksoftirqd/319:40:003
1408299436,9cyclictest1319-21snmpd00:11:242
1408299435,16cyclictest30987-21taskset20:46:282
1408299435,15cyclictest9473-21/usr/sbin/munin00:25:132
14082994337,3cyclictest28764-21grep21:49:592
1408099439,4cyclictest9-21ksoftirqd/020:25:140
1408099434,3cyclictest121rcu_preempt20:05:000
14080994312,5cyclictest9-21ksoftirqd/021:35:180
1408399425,8cyclictest41-21ksoftirqd/322:00:003
14083994237,3cyclictest13906-21cron21:20:013
14083994236,3cyclictest41-21ksoftirqd/300:39:593
14083994210,7cyclictest41-21ksoftirqd/322:15:003
1408299425,7cyclictest15513-21memory00:35:242
1408299425,16cyclictest1319-21snmpd19:19:182
1408299424,8cyclictest28043-21ls22:50:192
1408099429,7cyclictest9-21ksoftirqd/022:00:010
1408099428,4cyclictest9-21ksoftirqd/000:15:010
1408099425,4cyclictest9-21ksoftirqd/021:25:290
14080994212,5cyclictest9-21ksoftirqd/021:00:010
14080994210,5cyclictest9-21ksoftirqd/020:20:240
138491420,0ptp4l401ktimersoftd/322:17:243
138491420,0ptp4l401ktimersoftd/321:28:343
14083994129,9cyclictest41-21ksoftirqd/321:30:253
14083994111,3cyclictest41-21ksoftirqd/320:40:163
1408299415,7cyclictest24503-21df20:35:142
1408199410,1cyclictest0-21swapper/100:14:131
138491410,0ptp4l401ktimersoftd/323:59:373
1408399408,4cyclictest41-21ksoftirqd/300:25:293
1408399407,9cyclictest41-21ksoftirqd/320:55:003
14083994029,9cyclictest41-21ksoftirqd/322:40:243
14083994011,4cyclictest41-21ksoftirqd/321:05:283
14080994015,6cyclictest9-21ksoftirqd/019:40:180
1408399399,4cyclictest41-21ksoftirqd/320:25:133
1408399399,3cyclictest41-21ksoftirqd/322:35:013
1408399397,5cyclictest41-21ksoftirqd/319:25:213
1408399397,4cyclictest41-21ksoftirqd/300:20:303
1408399396,4cyclictest41-21ksoftirqd/323:30:273
1408399394,9cyclictest41-21ksoftirqd/323:44:593
14083993933,3cyclictest41-21ksoftirqd/322:45:253
14080993934,2cyclictest9-21ksoftirqd/023:50:180
14080993913,9cyclictest9-21ksoftirqd/022:50:240
14080993913,6cyclictest9-21ksoftirqd/021:05:190
14080993911,7cyclictest9-21ksoftirqd/019:50:140
1408399386,2cyclictest41-21ksoftirqd/321:40:163
14083993833,3cyclictest41-21ksoftirqd/323:05:203
14083993833,3cyclictest41-21ksoftirqd/319:50:003
14083993832,3cyclictest41-21ksoftirqd/320:15:153
14083993810,4cyclictest41-21ksoftirqd/319:40:213
14082993833,3cyclictest33-21ksoftirqd/200:35:002
1408399376,4cyclictest41-21ksoftirqd/320:25:003
1408399374,4cyclictest41-21ksoftirqd/322:50:233
1408399373,4cyclictest41-21ksoftirqd/323:50:293
1408399373,2cyclictest121rcu_preempt00:00:163
14083993732,2cyclictest41-21ksoftirqd/323:15:153
14083993732,2cyclictest41-21ksoftirqd/319:20:183
14083993731,3cyclictest41-21ksoftirqd/322:05:263
1408399372,8cyclictest41-21ksoftirqd/319:55:003
14081993711,25cyclictest2477-21kworker/1:223:58:241
1408399367,7cyclictest41-21ksoftirqd/321:20:253
1408399366,2cyclictest121rcu_preempt22:55:303
1408399365,3cyclictest121rcu_preempt20:35:143
1408399364,5cyclictest41-21ksoftirqd/321:45:253
1408399364,4cyclictest41-21ksoftirqd/321:10:183
1408399363,5cyclictest121rcu_preempt22:25:213
14083993632,2cyclictest41-21ksoftirqd/300:10:233
14083993631,3cyclictest41-21ksoftirqd/323:45:213
14083993631,3cyclictest41-21ksoftirqd/320:50:003
14083993631,2cyclictest41-21ksoftirqd/323:25:213
14083993630,4cyclictest41-21ksoftirqd/323:13:113
14083993630,4cyclictest41-21ksoftirqd/319:18:113
14083993630,3cyclictest41-21ksoftirqd/322:35:143
1408399362,9cyclictest41-21ksoftirqd/321:35:173
1408299367,16cyclictest747-21timerwakeupswit20:50:252
14081993630,4cyclictest25-21ksoftirqd/123:24:481
1408399356,3cyclictest41-21ksoftirqd/321:50:143
1408399356,3cyclictest41-21ksoftirqd/321:00:183
1408399354,9cyclictest41-21ksoftirqd/323:00:193
1408399354,10cyclictest41-21ksoftirqd/320:10:173
14083993530,3cyclictest41-21ksoftirqd/322:05:003
14083993530,3cyclictest41-21ksoftirqd/320:00:013
14083993529,3cyclictest41-21ksoftirqd/323:20:133
14082993530,3cyclictest33-21ksoftirqd/223:59:082
14082993529,4cyclictest33-21ksoftirqd/220:55:042
14081993530,3cyclictest6493-21cron00:20:001
14081993529,4cyclictest25-21ksoftirqd/122:52:511
14081993529,4cyclictest25-21ksoftirqd/120:03:431
14081993529,4cyclictest25-21ksoftirqd/119:47:061
14083993427,4cyclictest41-21ksoftirqd/300:15:103
1408399341,11cyclictest41-21ksoftirqd/300:30:243
1408299348,10cyclictest25549-21gzip23:50:272
1408299344,10cyclictest0-21swapper/219:40:212
14082993428,4cyclictest33-21ksoftirqd/221:40:072
14082993428,4cyclictest33-21ksoftirqd/221:19:142
14081993428,4cyclictest25-21ksoftirqd/123:51:081
14081993428,4cyclictest25-21ksoftirqd/122:31:491
14081993428,4cyclictest25-21ksoftirqd/121:39:431
14081993428,4cyclictest25-21ksoftirqd/121:02:521
14081993428,4cyclictest25-21ksoftirqd/120:12:251
14081993428,4cyclictest25-21ksoftirqd/119:10:311
14081993428,4cyclictest25-21ksoftirqd/100:32:441
14081993428,4cyclictest25-21ksoftirqd/100:01:391
1408399331,7cyclictest41-21ksoftirqd/320:30:193
14082993327,4cyclictest33-21ksoftirqd/223:31:082
14081993328,3cyclictest25-21ksoftirqd/121:00:001
14081993327,4cyclictest25-21ksoftirqd/123:41:371
14081993327,4cyclictest25-21ksoftirqd/123:18:341
14081993327,4cyclictest25-21ksoftirqd/122:37:231
14081993327,4cyclictest25-21ksoftirqd/122:21:301
14081993327,4cyclictest25-21ksoftirqd/122:04:131
14081993327,4cyclictest25-21ksoftirqd/119:44:251
14081993327,4cyclictest25-21ksoftirqd/119:39:481
14081993327,4cyclictest25-21ksoftirqd/100:08:251
14081993326,5cyclictest25-21ksoftirqd/119:24:111
1408299325,15cyclictest22713-21ls23:45:232
14082993226,4cyclictest33-21ksoftirqd/222:01:222
14081993227,3cyclictest25-21ksoftirqd/122:18:211
14081993227,3cyclictest25-21ksoftirqd/122:13:561
14081993227,3cyclictest25-21ksoftirqd/121:07:321
14081993227,3cyclictest25-21ksoftirqd/120:36:161
14081993226,4cyclictest25-21ksoftirqd/123:01:551
14081993226,4cyclictest25-21ksoftirqd/122:09:231
14081993226,4cyclictest25-21ksoftirqd/121:21:081
14081993226,4cyclictest25-21ksoftirqd/120:46:431
14081993226,4cyclictest25-21ksoftirqd/119:17:001
14081993226,3cyclictest25-21ksoftirqd/119:55:001
14082993126,3cyclictest33-21ksoftirqd/220:24:042
14082993125,4cyclictest33-21ksoftirqd/221:37:422
14082993125,4cyclictest33-21ksoftirqd/221:32:092
14081993126,3cyclictest25-21ksoftirqd/121:47:121
14081993126,3cyclictest25-21ksoftirqd/119:32:171
14081993125,4cyclictest25-21ksoftirqd/122:59:211
14081993125,4cyclictest25-21ksoftirqd/121:12:391
14081993125,4cyclictest25-21ksoftirqd/100:38:421
1408199310,2cyclictest0-21swapper/100:22:341
14082993024,4cyclictest33-21ksoftirqd/222:06:002
14081993025,3cyclictest25-21ksoftirqd/123:39:471
14081993025,3cyclictest25-21ksoftirqd/123:13:571
14081993025,3cyclictest25-21ksoftirqd/121:58:461
14081993025,3cyclictest25-21ksoftirqd/121:54:071
14081993025,3cyclictest25-21ksoftirqd/121:41:261
14081993025,3cyclictest25-21ksoftirqd/121:17:101
14081993025,3cyclictest25-21ksoftirqd/120:29:241
14081993024,4cyclictest25-21ksoftirqd/123:25:361
14081993024,4cyclictest25-21ksoftirqd/123:08:411
14081993024,4cyclictest25-21ksoftirqd/120:52:361
14081993024,4cyclictest25-21ksoftirqd/120:21:151
14081993024,4cyclictest25-21ksoftirqd/119:56:251
14081993023,5cyclictest25-21ksoftirqd/123:34:311
14082992924,3cyclictest33-21ksoftirqd/220:15:142
14081992923,4cyclictest25-21ksoftirqd/119:27:081
14081992923,4cyclictest25-21ksoftirqd/100:26:071
14082992822,4cyclictest33-21ksoftirqd/220:29:192
14081992822,4cyclictest25-21ksoftirqd/123:48:431
14082992721,3cyclictest33-21ksoftirqd/221:23:592
14081992620,4cyclictest25-21ksoftirqd/121:32:371
14081992520,3cyclictest25-21ksoftirqd/122:40:041
1408299248,13cyclictest10909-21taskset23:20:272
14081992419,3cyclictest25-21ksoftirqd/122:25:181
14081992419,3cyclictest25-21ksoftirqd/120:05:141
14081992418,4cyclictest25-21ksoftirqd/122:49:021
14081992418,4cyclictest25-21ksoftirqd/120:32:071
14081992319,3cyclictest25-21ksoftirqd/120:15:141
14081992117,3cyclictest25-21ksoftirqd/121:25:131
14081992117,3cyclictest25-21ksoftirqd/120:40:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional