You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 06:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Mon Mar 30, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13767991192,86cyclictest29109-21apt-get19:49:262
13767991192,86cyclictest29109-21apt-get19:49:262
13767991182,83cyclictest28958-21dpkg23:05:112
137629911550,33cyclictest28841-21ssh22:09:551
137629910351,42cyclictest803-21sendmail-mta00:11:201
1331121036,17sleep10-21swapper/119:00:261
1942221000,6sleep219398-21ssh21:54:462
13767999970,20cyclictest12001-21sh00:24:492
13762999726,36cyclictest21049-21sh22:50:391
13767999646,13cyclictest0-21swapper/222:04:552
1376299952,81cyclictest0-21swapper/121:39:281
13767999459,14cyclictest181rcu_preempt22:28:452
13767999445,14cyclictest0-21swapper/221:47:032
13767999351,11cyclictest181rcu_preempt19:44:432
13767999344,15cyclictest0-21swapper/223:30:232
13767999340,38cyclictest0-21swapper/221:53:232
13767999312,51cyclictest39-21ksoftirqd/220:13:132
13767999312,51cyclictest39-21ksoftirqd/220:13:132
13762999249,37cyclictest352-21runrttasks21:53:491
13767999160,22cyclictest30952-21fschecks_count19:54:362
13767999156,8cyclictest181rcu_preempt21:10:492
13767999053,13cyclictest181rcu_preempt20:54:162
13762999026,31cyclictest0-21swapper/123:12:081
13762999026,31cyclictest0-21swapper/123:12:081
13762999021,38cyclictest0-21swapper/122:42:231
13762999021,38cyclictest0-21swapper/122:42:231
13767998964,18cyclictest13745-21cyclictest23:14:512
13767998950,17cyclictest181rcu_preempt00:01:272
13767998950,17cyclictest181rcu_preempt00:01:272
13767998936,37cyclictest0-21swapper/219:19:522
13762998967,15cyclictest23591-21sh22:54:481
13767998860,18cyclictest27076-21latency_hist19:44:162
13767998851,17cyclictest181rcu_preempt23:20:152
13767998851,17cyclictest181rcu_preempt23:20:152
13767998844,9cyclictest0-21swapper/222:13:222
13767998843,12cyclictest181rcu_preempt00:05:052
13762998846,34cyclictest0-21swapper/123:59:251
13762998846,34cyclictest0-21swapper/123:59:251
13762998844,36cyclictest0-21swapper/121:44:481
13767998755,8cyclictest181rcu_preempt23:39:302
13767998753,8cyclictest181rcu_preempt20:54:522
13767998748,14cyclictest181rcu_preempt19:09:392
13767998748,14cyclictest181rcu_preempt19:09:392
13762998745,34cyclictest0-21swapper/121:15:461
13762998742,35cyclictest1240-21modprobe20:04:141
13762998726,27cyclictest0-21swapper/122:19:371
13767998650,8cyclictest181rcu_preempt23:44:472
13767998638,13cyclictest0-21swapper/222:55:422
13767998637,12cyclictest181rcu_preempt22:30:012
13767998629,18cyclictest0-21swapper/222:50:472
13762998640,41cyclictest0-21swapper/123:04:261
13762998622,34cyclictest20889-21diskmemload22:32:471
13762998621,29cyclictest0-21swapper/122:25:441
13762998616,48cyclictest30359-21sh21:19:291
13767998564,15cyclictest7059-21fschecks_count21:34:352
13767998563,8cyclictest181rcu_preempt20:39:362
13767998557,20cyclictest28601-21sh23:59:132
13767998556,8cyclictest181rcu_preempt22:34:402
13767998556,8cyclictest181rcu_preempt22:34:402
13767998532,8cyclictest181rcu_preempt20:34:352
13767998528,24cyclictest0-21swapper/223:54:172
13767998528,24cyclictest0-21swapper/223:54:172
13758998555,21cyclictest12637-21latency_hist21:44:170
13767998459,9cyclictest181rcu_preempt22:40:462
13767998459,9cyclictest181rcu_preempt22:40:462
13767998458,17cyclictest21954-21sh21:59:352
13767998458,17cyclictest21954-21sh21:59:352
13767998456,19cyclictest22253-21sh21:04:512
1376299846,49cyclictest0-21swapper/122:02:031
1376299846,49cyclictest0-21swapper/122:02:031
13762998445,31cyclictest14334-21ssh00:29:311
13762998445,31cyclictest14334-21ssh00:29:311
1376299843,71cyclictest0-21swapper/120:19:281
1376299843,48cyclictest352-21runrttasks20:36:381
13762998416,46cyclictest28408-21seq19:46:481
13758998460,16cyclictest0-21swapper/022:04:260
13767998338,9cyclictest0-21swapper/221:20:522
13767998337,14cyclictest0-21swapper/222:47:312
13767998320,21cyclictest0-21swapper/200:16:322
13762998365,12cyclictest277-21dbus-daemon20:29:151
13762998360,17cyclictest20131-21cpuspeed23:44:301
1376299833,70cyclictest0-21swapper/120:39:291
1376299833,48cyclictest352-21runrttasks20:17:221
13758998368,10cyclictest13745-21cyclictest23:35:400
13758998333,27cyclictest16090-21ssh00:32:080
13758998333,27cyclictest16090-21ssh00:32:080
1375899832,67cyclictest28766-21apt-get23:04:300
135202836,16sleep00-21swapper/019:03:100
13767998258,9cyclictest181rcu_preempt00:09:342
13767998247,16cyclictest181rcu_preempt20:04:182
13767998247,14cyclictest181rcu_preempt20:59:342
13767998244,15cyclictest181rcu_preempt19:29:462
1376299824,56cyclictest0-21swapper/119:40:411
13767998151,8cyclictest181rcu_preempt23:34:422
13767998149,15cyclictest181rcu_preempt22:22:452
13767998147,8cyclictest181rcu_preempt19:04:252
13767998139,11cyclictest181rcu_preempt19:34:372
13767998123,27cyclictest0-21swapper/223:26:112
13767998118,23cyclictest0-21swapper/223:11:152
13767998118,23cyclictest0-21swapper/223:11:152
13762998152,21cyclictest6678-21sh00:15:321
1376299814,66cyclictest31884-21apt-get00:04:251
1376299813,73cyclictest0-21swapper/123:19:441
1376299813,73cyclictest0-21swapper/123:19:441
13762998137,37cyclictest0-21swapper/123:24:411
1376299813,66cyclictest0-21swapper/120:29:281
13762998130,43cyclictest0-21swapper/119:14:351
13762998130,43cyclictest0-21swapper/119:14:351
1376299812,65cyclictest0-21swapper/120:59:271
13758998148,26cyclictest13745-21cyclictest22:38:060
13758998148,26cyclictest13745-21cyclictest22:38:060
13767998048,14cyclictest181rcu_preempt20:18:352
13767998032,17cyclictest0-21swapper/221:28:062
13758998010,34cyclictest15-21ksoftirqd/021:23:250
1359928011,44sleep213618-21sh19:04:142
1376799798,61cyclictest27675-21ssh21:15:182
13767997949,10cyclictest181rcu_preempt21:42:042
13767997947,10cyclictest181rcu_preempt19:59:362
13767997942,9cyclictest181rcu_preempt19:14:492
13767997942,9cyclictest181rcu_preempt19:14:492
13762997958,15cyclictest24863-21sh22:04:241
1376299793,65cyclictest2102-21apt-get23:14:251
1376299792,48cyclictest352-21runrttasks19:54:211
13758997964,9cyclictest13745-21cyclictest23:19:160
13758997958,14cyclictest0-21swapper/022:44:160
13758997958,14cyclictest0-21swapper/022:44:160
13767997848,12cyclictest181rcu_preempt20:19:472
13767997826,8cyclictest0-21swapper/219:24:222
13762997836,34cyclictest0-21swapper/123:34:361
13762997828,42cyclictest0-21swapper/122:34:391
13762997828,42cyclictest0-21swapper/122:34:391
1375899784,23cyclictest0-21swapper/023:43:550
13767997753,15cyclictest28701-21apt-key23:04:192
13767997736,8cyclictest181rcu_preempt20:24:352
13767997736,12cyclictest0-21swapper/200:23:162
13767997736,12cyclictest0-21swapper/200:23:162
13767997729,12cyclictest0-21swapper/220:29:332
13767997718,22cyclictest0-21swapper/221:31:532
1376299779,46cyclictest0-21swapper/123:55:111
1376299779,42cyclictest9483-21grep21:39:131
1376299774,51cyclictest0-21swapper/123:42:301
1375899773,42cyclictest2656-21grep00:09:370
1375899773,32cyclictest4934-21diskstats22:25:260
13767997642,14cyclictest181rcu_preempt20:44:232
13767997642,12cyclictest181rcu_preempt22:14:592
1376299769,42cyclictest0-21swapper/119:07:561
1376299764,67cyclictest0-21swapper/123:29:261
1376299764,57cyclictest844-21ssh21:24:251
1376299763,63cyclictest352-21runrttasks19:50:121
1376299763,63cyclictest352-21runrttasks19:50:121
1376299763,63cyclictest0-21swapper/121:29:281
13762997632,39cyclictest0-21swapper/122:45:471
1376299762,63cyclictest0-21swapper/120:04:291
1376299762,44cyclictest22598-21grep19:29:351
13758997653,16cyclictest23354-21mailstats22:54:450
1375899763,61cyclictest29109-21apt-get19:49:310
1375899763,61cyclictest29109-21apt-get19:49:310
13758997614,37cyclictest15-21ksoftirqd/023:54:230
13767997554,12cyclictest15627-21ssh00:30:472
13767997554,12cyclictest15627-21ssh00:30:472
1376299753,64cyclictest26187-21ssh22:59:421
13762997533,31cyclictest0-21swapper/122:16:141
1376299752,58cyclictest0-21swapper/120:54:301
13762997515,33cyclictest0-21swapper/120:11:431
13762997515,33cyclictest0-21swapper/120:11:431
1375899753,59cyclictest30187-21latency_hist21:19:170
13758997458,10cyclictest300-21rs:main0
1375899743,39cyclictest481-21ps19:59:460
1375899743,38cyclictest30807-21latency_hist22:14:170
13758997413,26cyclictest0-21swapper/021:54:240
13758997411,27cyclictest0-21swapper/021:24:450
1376299734,60cyclictest0-21swapper/119:19:311
1376299733,61cyclictest0-21swapper/123:49:281
1376299733,61cyclictest0-21swapper/123:49:281
13762997331,35cyclictest0-21swapper/100:24:511
1376299732,62cyclictest16578-21idleruntime20:49:361
13758997355,13cyclictest23149-21switchtime19:29:480
13758997350,15cyclictest20889-21diskmemload22:01:560
13758997350,15cyclictest20889-21diskmemload22:01:560
1375899733,49cyclictest25806-21fschecks_count22:59:340
13758997333,31cyclictest19260-21modprobe20:59:140
1375899732,27cyclictest15-21ksoftirqd/021:33:080
1376299723,59cyclictest21929-21ssh21:04:471
13762997228,37cyclictest0-21swapper/100:19:171
13762997228,37cyclictest0-21swapper/100:19:171
1375899727,41cyclictest15-21ksoftirqd/019:13:240
1375899727,41cyclictest15-21ksoftirqd/019:13:240
1375899723,37cyclictest15-21ksoftirqd/020:14:330
13758997229,32cyclictest0-21swapper/023:30:170
13758997215,24cyclictest19191-21rm22:48:460
1376299714,57cyclictest0-21swapper/119:24:261
1376299714,54cyclictest21558-21ssh21:59:171
13762997130,32cyclictest0-21swapper/119:34:391
13762997128,33cyclictest0-21swapper/121:09:321
13758997154,10cyclictest20889-21diskmemload21:12:040
1375899715,39cyclictest15-21ksoftirqd/019:08:330
1375899714,47cyclictest9314-21tail00:19:500
1375899714,47cyclictest9314-21tail00:19:500
13758997143,22cyclictest0-21swapper/023:54:170
13758997143,22cyclictest0-21swapper/023:54:170
1375899713,41cyclictest15-21ksoftirqd/020:42:290
1375899713,32cyclictest15-21ksoftirqd/019:41:290
13758997120,25cyclictest20856-21seq22:50:050
13758997118,26cyclictest30517-21seq00:01:150
13758997118,26cyclictest30517-21seq00:01:150
13762997026,38cyclictest16195-21fschecks_time19:09:391
13762997026,38cyclictest16195-21fschecks_time19:09:391
1375899708,28cyclictest1858-21ssh00:08:450
1375899706,38cyclictest15-21ksoftirqd/019:45:500
1375899703,25cyclictest0-21swapper/021:52:120
1375899702,38cyclictest15-21ksoftirqd/020:04:460
1375899695,38cyclictest15-21ksoftirqd/022:29:440
1375899694,33cyclictest352-21runrttasks23:20:280
1375899694,33cyclictest352-21runrttasks23:20:280
1375899693,46cyclictest12519-21kworker/u19:0+flush-179:020:44:440
13758996925,8cyclictest161ktimers/000:14:320
1376299683,60cyclictest0-21swapper/120:45:221
1375899689,9cyclictest15-21ksoftirqd/021:34:450
1375899686,32cyclictest15-21ksoftirqd/023:13:040
1375899686,32cyclictest15-21ksoftirqd/023:13:040
13758996849,13cyclictest300-21rs:main0
1375899683,25cyclictest8244-21sort20:24:370
13758996827,26cyclictest15-21ksoftirqd/020:23:110
1375899682,46cyclictest15-21ksoftirqd/021:00:310
1375899682,35cyclictest352-21runrttasks21:05:080
1375899675,37cyclictest15-21ksoftirqd/022:18:540
1375899675,37cyclictest15-21ksoftirqd/019:54:410
1375899674,36cyclictest15-21ksoftirqd/000:25:050
13758996721,12cyclictest161ktimers/021:46:520
13758996646,14cyclictest0-21swapper/020:14:130
13758996646,14cyclictest0-21swapper/020:14:130
13758996645,13cyclictest19446-21fschecks_time19:19:370
1375899663,39cyclictest15-21ksoftirqd/019:37:450
1375899662,38cyclictest15-21ksoftirqd/020:35:400
1375899662,37cyclictest15-21ksoftirqd/019:17:500
1375899662,37cyclictest15-21ksoftirqd/019:17:500
13758996548,9cyclictest8437-21rm23:24:340
13758996544,15cyclictest21705-21unixbench_multi19:24:480
1375899653,37cyclictest15-21ksoftirqd/020:33:410
1375899634,26cyclictest15-21ksoftirqd/020:51:500
13772995641,10cyclictest451rcuc/322:25:483
1377299563,39cyclictest3732-21taskset21:29:173
1377299553,40cyclictest13780-21taskset19:04:183
1377299543,39cyclictest24687-21taskset19:34:483
1377299542,40cyclictest10722-21taskset23:28:513
1377299533,37cyclictest12643-21chrt20:39:163
1377299533,36cyclictest18736-21chrt21:54:273
1377299533,35cyclictest26554-21chrt19:39:503
1377299532,37cyclictest28724-21chrt23:04:193
1377299532,35cyclictest2054-21chrt20:04:453
1377299523,35cyclictest10972-21chrt20:34:143
1377299523,34cyclictest5673-21chrt20:14:503
1377299522,38cyclictest32398-21chrt22:15:553
1377299522,38cyclictest20313-21taskset22:49:443
1377299522,38cyclictest10861-21taskset21:39:513
13772995136,10cyclictest451rcuc/319:49:523
13772995136,10cyclictest451rcuc/319:49:523
1377299513,35cyclictest25427-21chrt22:59:163
1377299513,34cyclictest13385-21chrt22:39:173
1377299513,34cyclictest13385-21chrt22:39:173
1377299513,32cyclictest8076-21chrt23:24:173
1377299513,32cyclictest8076-21chrt23:24:173
1377299512,34cyclictest31183-21chrt21:19:533
1377299504,32cyclictest29681-21chrt23:59:483
1377299504,32cyclictest29681-21chrt23:59:483
13772995035,10cyclictest451rcuc/323:33:053
1377299503,34cyclictest20871-21chrt23:44:483
1377299503,33cyclictest16892-21chrt20:49:453
1377299503,32cyclictest28867-21chrt21:16:003
1377299503,32cyclictest2650-21chrt00:09:373
1377299502,38cyclictest13125-21taskset21:44:383
1377299502,37cyclictest32740-21taskset19:59:393
1377299502,37cyclictest26578-21chrt23:54:413
1377299502,36cyclictest22435-21chrt21:05:133
1377299502,36cyclictest18311-21taskset19:14:483
1377299502,36cyclictest18311-21taskset19:14:483
1377299502,36cyclictest13948-21chrt00:29:153
1377299502,33cyclictest27973-21chrt22:09:313
13772994934,10cyclictest451rcuc/319:24:413
1377299493,35cyclictest4046-21chrt21:29:343
1377299493,33cyclictest25767-21chrt23:54:173
1377299493,33cyclictest25767-21chrt23:54:173
1377299493,33cyclictest23376-21chrt19:29:503
1377299492,34cyclictest24197-21chrt22:03:513
1377299492,34cyclictest24197-21chrt22:03:513
1377299492,33cyclictest14810-21chrt00:29:443
1377299492,33cyclictest14810-21chrt00:29:443
13772994910,32cyclictest0-21swapper/320:44:453
161332484,31sleep30-21swapper/319:09:383
161332484,31sleep30-21swapper/319:09:383
1377299483,36cyclictest25414-21taskset21:10:113
1377299483,32cyclictest7439-21chrt21:34:453
1377299483,32cyclictest25573-21chrt22:05:343
1377299483,30cyclictest16871-21chrt21:49:573
1377299482,34cyclictest413-21taskset00:04:513
1377299482,33cyclictest6218-21chrt00:14:483
1377299482,32cyclictest14556-21chrt19:04:473
13772994734,9cyclictest451rcuc/322:32:333
1377299473,30cyclictest31012-21chrt19:54:373
1377299472,31cyclictest17691-21chrt22:45:423
1377299463,31cyclictest27751-21chrt19:44:403
13772994630,9cyclictest451rcuc/300:22:423
13772994630,9cyclictest451rcuc/300:22:423
13772994533,8cyclictest451rcuc/319:22:053
13772994530,11cyclictest451rcuc/323:15:463
1377299452,34cyclictest441-21chrt23:10:303
1377299452,34cyclictest441-21chrt23:10:303
13772994331,8cyclictest451rcuc/320:20:543
1377299432,32cyclictest25620-21taskset22:59:293
1377299423,28cyclictest4118-21taskset22:24:143
1377299423,27cyclictest20924-21chrt21:04:153
1377299423,27cyclictest17100-21taskset23:39:253
1377299423,27cyclictest14105-21chrt23:34:183
1377299413,28cyclictest18714-21chrt20:54:523
13772994127,9cyclictest451rcuc/320:11:103
13772994127,9cyclictest451rcuc/320:11:103
1377299412,30cyclictest13866-21taskset22:40:193
1377299412,30cyclictest13866-21taskset22:40:193
1377299403,25cyclictest8432-21taskset20:24:423
1377299393,26cyclictest14200-21chrt20:44:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional