You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 17:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Mar 29, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40321880,24sleep1402-21df_inode07:00:341
131621327,15sleep00-21swapper/007:01:490
993921010,7sleep29929-21ssh10:54:172
536821010,6sleep10-21swapper/109:50:561
1662999951,8cyclictest181rcu_preempt07:04:442
211092980,7sleep20-21swapper/208:00:442
1658999855,14cyclictest10077-21ssh11:48:191
1658999853,14cyclictest181rcu_preempt10:09:371
1658999853,14cyclictest181rcu_preempt10:09:371
1662999573,17cyclictest1640-21cyclictest09:54:152
1658999549,12cyclictest181rcu_preempt10:06:571
1658999549,12cyclictest181rcu_preempt10:06:571
1658999539,21cyclictest0-21swapper/109:47:091
1658999370,13cyclictest30904-21latency09:39:421
1658999334,11cyclictest1640-21cyclictest11:12:491
1662999151,13cyclictest181rcu_preempt11:53:242
1649999124,35cyclictest0-21swapper/009:30:140
1662999051,11cyclictest181rcu_preempt07:29:192
166299904,62cyclictest1886-21ssh11:34:372
1662998958,9cyclictest181rcu_preempt11:42:022
1662998949,16cyclictest181rcu_preempt08:19:442
1658998961,10cyclictest181rcu_preempt10:33:511
1658998944,15cyclictest181rcu_preempt07:14:431
1658998944,15cyclictest181rcu_preempt07:14:431
1662998853,9cyclictest181rcu_preempt09:54:452
1662998853,9cyclictest181rcu_preempt09:54:452
1658998862,9cyclictest181rcu_preempt07:19:501
1658998862,9cyclictest181rcu_preempt07:19:501
157628814,48sleep21575-21/usr/sbin/munin07:04:192
1662998749,13cyclictest181rcu_preempt07:14:412
1662998749,13cyclictest181rcu_preempt07:14:412
1658998756,17cyclictest181rcu_preempt11:22:541
165899875,56cyclictest1832-21apt-get11:34:321
1662998654,8cyclictest181rcu_preempt10:14:192
1662998654,8cyclictest181rcu_preempt10:14:192
1662998652,8cyclictest181rcu_preempt08:54:322
1662998652,8cyclictest181rcu_preempt08:54:322
1662998651,13cyclictest181rcu_preempt09:18:562
1662998651,13cyclictest181rcu_preempt09:18:562
1662998640,21cyclictest58-21kcompactd008:44:272
1658998628,25cyclictest0-21swapper/108:24:521
1662998568,12cyclictest1640-21cyclictest08:44:192
1662998540,18cyclictest30709-21/usr/sbin/munin10:34:492
1658998553,9cyclictest181rcu_preempt09:10:571
1658998551,7cyclictest181rcu_preempt11:50:191
1662998467,11cyclictest16178-21unixbench_singl07:44:512
1662998448,12cyclictest181rcu_preempt09:12:372
1662998415,45cyclictest39-21ksoftirqd/211:44:542
1658998458,9cyclictest181rcu_preempt09:19:441
1658998451,8cyclictest181rcu_preempt10:54:381
1662998365,12cyclictest16337-21ssh11:04:342
1662998354,7cyclictest181rcu_preempt07:14:172
1662998351,9cyclictest181rcu_preempt09:48:132
1662998350,7cyclictest181rcu_preempt09:24:412
1662998350,7cyclictest181rcu_preempt09:24:412
1662998350,15cyclictest181rcu_preempt11:54:402
1662998347,8cyclictest181rcu_preempt09:00:182
1662998341,9cyclictest0-21swapper/211:10:092
1658998359,18cyclictest8790-21diskmemload09:59:531
1658998357,11cyclictest181rcu_preempt11:00:021
1658998353,14cyclictest181rcu_preempt11:31:401
1658998350,7cyclictest181rcu_preempt07:39:191
1658998350,10cyclictest181rcu_preempt12:09:181
1658998350,10cyclictest181rcu_preempt12:09:181
1658998349,10cyclictest181rcu_preempt12:24:361
1658998330,12cyclictest0-21swapper/112:09:471
1658998329,27cyclictest0-21swapper/107:59:181
1658998329,27cyclictest0-21swapper/107:59:181
166899823,39cyclictest26453-21taskset09:32:293
1662998251,8cyclictest181rcu_preempt12:17:532
1662998246,10cyclictest181rcu_preempt10:22:042
1662998246,10cyclictest181rcu_preempt10:22:042
1658998232,9cyclictest0-21swapper/110:21:021
1658998232,9cyclictest0-21swapper/110:21:021
1658998226,23cyclictest0-21swapper/112:20:301
1649998217,14cyclictest13828-21sed10:04:530
1649998217,14cyclictest13828-21sed10:04:530
1662998157,11cyclictest0-21swapper/210:44:482
1658998165,10cyclictest1852-21kworker/u17:1+events_unbound11:43:561
1658998162,12cyclictest8790-21diskmemload11:04:541
1658998155,14cyclictest0-21swapper/109:34:191
1658998154,7cyclictest181rcu_preempt12:33:411
1658998153,8cyclictest181rcu_preempt11:56:481
1658998152,20cyclictest24211-21apt-key09:29:191
1658998152,20cyclictest24211-21apt-key09:29:191
1658998148,12cyclictest181rcu_preempt10:39:191
1658998142,22cyclictest0-21swapper/111:18:141
1658998126,21cyclictest0-21swapper/108:00:381
1658998124,13cyclictest0-21swapper/109:34:331
166899808,50cyclictest0-21swapper/311:34:433
166899802,37cyclictest14992-21chrt11:01:523
1662998049,13cyclictest181rcu_preempt07:34:512
1662998048,10cyclictest181rcu_preempt07:49:382
1662998048,10cyclictest181rcu_preempt07:49:382
1662998038,18cyclictest0-21swapper/212:29:172
1658998053,14cyclictest7291-21cpuspeed10:49:331
165899802,36cyclictest31-21ksoftirqd/107:29:321
166899795,52cyclictest0-21swapper/312:25:383
166899793,34cyclictest28987-21chrt09:36:103
1662997960,12cyclictest2952-21systemd-journal10:34:162
1662997946,16cyclictest58-21kcompactd008:31:152
1662997946,16cyclictest58-21kcompactd008:31:152
1662997945,7cyclictest181rcu_preempt10:01:142
1662997941,9cyclictest0-21swapper/212:30:142
1662997937,20cyclictest58-21kcompactd008:09:192
1662997933,10cyclictest0-21swapper/208:34:442
1662997933,10cyclictest0-21swapper/208:34:442
1658997956,10cyclictest181rcu_preempt08:34:491
1658997956,10cyclictest181rcu_preempt08:34:491
1658997930,8cyclictest0-21swapper/112:02:001
1658997927,18cyclictest0-21swapper/108:54:191
1649997959,14cyclictest18901-21latency_hist11:09:170
1662997838,19cyclictest0-21swapper/208:49:472
1662997835,8cyclictest0-21swapper/210:15:262
1658997842,8cyclictest181rcu_preempt07:09:501
1658997841,8cyclictest181rcu_preempt09:55:031
1658997841,8cyclictest181rcu_preempt09:55:031
1658997840,9cyclictest181rcu_preempt08:39:361
1658997832,23cyclictest0-21swapper/108:54:361
1658997832,23cyclictest0-21swapper/108:54:361
1658997829,8cyclictest0-21swapper/110:19:101
1658997825,21cyclictest0-21swapper/110:41:571
1662997749,8cyclictest181rcu_preempt10:26:592
1662997735,8cyclictest181rcu_preempt09:07:112
1662997735,11cyclictest181rcu_preempt11:24:412
1662997735,11cyclictest181rcu_preempt11:24:412
1658997749,8cyclictest181rcu_preempt08:16:191
1658997730,14cyclictest0-21swapper/109:15:251
1658997730,14cyclictest0-21swapper/109:15:251
1649997758,13cyclictest27836-21latency_hist11:24:180
166899762,30cyclictest29173-21chrt11:24:553
166899762,30cyclictest29173-21chrt11:24:553
1662997654,12cyclictest0-21swapper/208:24:382
1662997648,12cyclictest181rcu_preempt09:38:182
1662997647,8cyclictest181rcu_preempt07:54:402
1662997647,8cyclictest181rcu_preempt07:54:402
166299763,33cyclictest39-21ksoftirqd/212:19:312
1662997626,12cyclictest0-21swapper/211:18:042
1658997641,8cyclictest181rcu_preempt10:46:331
1658997640,7cyclictest181rcu_preempt07:44:251
1658997629,10cyclictest0-21swapper/108:19:511
1658997628,24cyclictest0-21swapper/107:04:501
166899753,32cyclictest7937-21chrt11:44:333
166899753,32cyclictest4140-21chrt09:49:363
166899752,29cyclictest22306-21chrt09:25:373
166899752,29cyclictest22306-21chrt09:25:373
1662997552,15cyclictest11728-21munin-run07:34:162
1662997530,23cyclictest0-21swapper/212:06:302
1662997530,23cyclictest0-21swapper/212:06:302
1658997544,10cyclictest181rcu_preempt08:44:521
1658997537,16cyclictest181rcu_preempt11:24:201
1658997537,16cyclictest181rcu_preempt11:24:201
1658997535,7cyclictest181rcu_preempt10:27:151
165899753,31cyclictest8790-21diskmemload12:14:441
1649997554,14cyclictest16117-21needreboot09:15:370
1649997554,14cyclictest16117-21needreboot09:15:370
166899743,28cyclictest12357-21chrt10:57:513
166899742,36cyclictest30729-21taskset08:29:473
166899742,36cyclictest30729-21taskset08:29:473
166899742,33cyclictest21107-21chrt12:05:443
166899742,33cyclictest21107-21chrt12:05:443
1662997454,11cyclictest0-21swapper/210:44:182
1658997440,8cyclictest181rcu_preempt08:04:391
1658997432,21cyclictest0-21swapper/107:49:441
1658997432,21cyclictest0-21swapper/107:49:441
1649997460,10cyclictest1640-21cyclictest08:03:260
1649997459,9cyclictest1739-21ssh09:44:510
1649997457,13cyclictest3618-21kworker/u19:3+events_unbound11:04:160
1649997455,13cyclictest30716-21idleruntime-cro11:29:150
1649997455,13cyclictest30716-21idleruntime-cro11:29:150
1662997356,10cyclictest19440-1kworker/2:0H+kblockd11:19:452
1662997351,8cyclictest181rcu_preempt12:04:182
1662997336,20cyclictest0-21swapper/209:19:332
1662997332,12cyclictest0-21swapper/210:05:102
1662997332,12cyclictest0-21swapper/210:05:102
1658997341,13cyclictest181rcu_preempt07:39:331
1658997338,7cyclictest181rcu_preempt08:09:491
1658997338,7cyclictest181rcu_preempt08:09:491
1658997327,27cyclictest0-21swapper/109:06:521
1649997358,8cyclictest29285-21ssh12:19:520
1649997354,13cyclictest31586-21sh11:29:450
164999734,35cyclictest930-21idleruntime-cro10:39:160
1649997321,13cyclictest2031-21/usr/sbin/munin10:39:500
166899723,32cyclictest7271-21chrt09:54:393
166899723,32cyclictest7271-21chrt09:54:393
1662997255,9cyclictest0-21swapper/212:09:532
1662997254,9cyclictest0-21swapper/208:14:192
1662997254,9cyclictest0-21swapper/208:14:192
1662997243,8cyclictest181rcu_preempt09:33:542
1662997241,10cyclictest181rcu_preempt10:55:492
1662997227,12cyclictest0-21swapper/211:30:122
1658997257,10cyclictest1640-21cyclictest09:04:051
1649997256,10cyclictest1782-21ssh11:34:230
1649997215,14cyclictest11294-21unixbench_multi07:29:540
1649997213,11cyclictest9731-21ssh10:53:560
4122716,16sleep30-21swapper/307:00:373
166899714,29cyclictest10733-21taskset09:06:203
166899714,27cyclictest29533-21chrt10:31:523
166899713,26cyclictest27256-21taskset08:19:393
166899713,26cyclictest15779-21taskset09:15:283
166899713,26cyclictest15779-21taskset09:15:283
1662997137,10cyclictest181rcu_preempt07:19:382
1662997137,10cyclictest181rcu_preempt07:19:382
1662997136,20cyclictest0-21swapper/208:16:072
1662997134,8cyclictest181rcu_preempt10:59:282
1662997120,12cyclictest0-21swapper/209:41:302
1662997110,33cyclictest39-21ksoftirqd/207:39:442
1658997138,7cyclictest181rcu_preempt07:24:501
164999718,23cyclictest28592-21/usr/sbin/munin10:29:510
1649997158,8cyclictest12620-21processes07:34:470
1649997154,11cyclictest365-21ntpd07:44:370
1649997154,11cyclictest277-21dbus-daemon09:24:170
1649997116,12cyclictest0-21swapper/011:54:260
166899702,28cyclictest9451-21chrt10:53:093
1658997042,11cyclictest181rcu_preempt08:29:351
1658997042,11cyclictest181rcu_preempt08:29:351
1649997054,10cyclictest12903-21systemd-run10:59:160
1649997048,14cyclictest28480-21latency_hist08:24:190
164999699,8cyclictest0-21swapper/011:50:330
1649996954,9cyclictest9399-21ssh11:46:210
1649996952,11cyclictest17826-21sshd07:50:020
1649996952,11cyclictest17826-21sshd07:50:020
1649996950,13cyclictest13875-21fschecks_time07:39:400
164999693,37cyclictest0-21swapper/010:44:220
1649996921,9cyclictest22109-21/usr/sbin/munin11:14:510
1649996921,17cyclictest26684-21tail12:14:510
1649996918,9cyclictest0-21swapper/007:19:300
1649996918,9cyclictest0-21swapper/007:19:300
1649996918,15cyclictest9671-21/usr/sbin/munin09:04:440
166899683,28cyclictest5619-21chrt11:39:513
1668996813,13cyclictest0-21swapper/309:14:193
164999685,34cyclictest19856-21unixbench_multi10:14:520
1649996852,12cyclictest1640-21cyclictest09:37:140
1649996852,10cyclictest3384-21timerandwakeup08:44:510
1649996822,14cyclictest25478-21/usr/sbin/munin10:24:490
1649996817,13cyclictest16154-21sort10:09:390
1649996817,13cyclictest16154-21sort10:09:390
1649996816,9cyclictest18446-21/usr/sbin/munin07:54:410
1649996816,9cyclictest18446-21/usr/sbin/munin07:54:410
1649996816,15cyclictest5089-21grep08:49:510
1649996812,23cyclictest5833-21apt08:54:260
1649996812,23cyclictest5833-21apt08:54:260
1649996811,26cyclictest23273-21ntp_states12:09:440
1649996810,24cyclictest25377-21apt-get08:14:500
1649996810,10cyclictest0-21swapper/009:28:090
1649996810,10cyclictest0-21swapper/009:28:090
166899673,24cyclictest4260-21chrt12:32:023
164999675,32cyclictest0-21swapper/012:07:560
164999675,32cyclictest0-21swapper/012:07:560
1649996751,10cyclictest23406-21ssh10:21:190
1649996751,10cyclictest23406-21ssh10:21:190
1649996748,13cyclictest8790-21diskmemload12:04:120
164999673,31cyclictest31863-21apt-get12:24:470
164999672,28cyclictest15-21ksoftirqd/009:43:130
1649996721,16cyclictest8899-21latency_hist09:04:180
166899665,16cyclictest0-21swapper/308:19:153
166899662,24cyclictest16738-21chrt11:59:283
1649996619,12cyclictest12611-21date10:04:180
1649996618,14cyclictest24996-21apt-config08:14:170
1649996618,14cyclictest24996-21apt-config08:14:170
1649996616,12cyclictest4969-21unixbench_singl09:49:520
1649996614,16cyclictest3205-21true07:09:170
1668996512,14cyclictest0-21swapper/308:34:523
1668996512,14cyclictest0-21swapper/308:34:523
1649996551,10cyclictest1640-21cyclictest09:11:130
1649996519,9cyclictest5053-21/usr/sbin/munin11:39:380
1649996518,17cyclictest9522-21sort07:24:510
1649996516,12cyclictest6860-21runrttasks09:54:230
1649996516,12cyclictest6860-21runrttasks09:54:230
1649996510,19cyclictest4866-21vmstat07:09:560
166899646,17cyclictest0-21swapper/307:44:163
166899643,22cyclictest1040-21chrt10:39:183
1668996412,13cyclictest0-21swapper/310:09:253
1668996412,13cyclictest0-21swapper/310:09:253
1649996434,21cyclictest2310-21modprobe08:44:150
164999642,30cyclictest32542-21/usr/sbin/munin08:34:500
164999642,30cyclictest32542-21/usr/sbin/munin08:34:500
1649996420,8cyclictest0-21swapper/008:04:530
1649996419,8cyclictest0-21swapper/007:14:430
1649996419,8cyclictest0-21swapper/007:14:430
1649996416,27cyclictest20884-21runrttasks11:11:420
1649996415,8cyclictest5287-21latency_hist12:34:190
166899632,24cyclictest27846-21chrt11:24:183
1668996312,16cyclictest0-21swapper/310:19:393
1668996312,16cyclictest0-21swapper/310:19:393
1668996211,15cyclictest0-21swapper/307:09:533
164999627,22cyclictest0-21swapper/008:29:360
164999627,22cyclictest0-21swapper/008:29:360
1649996217,9cyclictest295942sleep008:25:060
166899603,42cyclictest5610-21taskset07:14:323
166899603,42cyclictest5610-21taskset07:14:323
166899574,35cyclictest32426-21chrt09:42:303
166899573,36cyclictest1356-21chrt09:44:413
166899572,37cyclictest20224-21chrt07:59:203
166899572,37cyclictest20224-21chrt07:59:203
166899563,41cyclictest23854-21chrt08:09:403
166899563,41cyclictest23854-21chrt08:09:403
166899563,38cyclictest19654-21taskset10:14:503
166899562,40cyclictest29107-21chrt08:24:453
166899553,35cyclictest28483-21chrt12:19:183
166899553,21cyclictest0-21swapper/308:00:183
166899552,38cyclictest21637-21chrt11:13:523
166899543,38cyclictest10936-21taskset11:49:363
166899543,35cyclictest6282-21chrt08:54:423
166899543,35cyclictest6282-21chrt08:54:423
166899542,39cyclictest699-21taskset11:32:463
166899542,37cyclictest4401-21chrt10:44:333
166899542,37cyclictest23331-21chrt11:15:103
166899533,36cyclictest15444-21chrt11:56:333
166899533,34cyclictest1201-21chrt10:39:223
166899523,36cyclictest7702-21chrt07:19:473
166899523,36cyclictest7702-21chrt07:19:473
166899523,35cyclictest13393-21taskset10:04:443
166899523,35cyclictest13393-21taskset10:04:443
166899522,35cyclictest11072-21taskset10:00:103
166899513,34cyclictest18055-21chrt11:07:073
166899512,37cyclictest26699-21taskset10:27:143
166899512,36cyclictest2730-21taskset07:04:523
166899512,34cyclictest17766-21chrt07:49:523
166899512,34cyclictest17766-21chrt07:49:523
166899503,36cyclictest4159-21chrt08:49:193
166899503,34cyclictest18397-21chrt09:19:333
166899502,36cyclictest15518-21chrt07:44:373
166899502,32cyclictest25617-21chrt12:14:193
166899493,35cyclictest31066-21chrt12:23:353
166899492,35cyclictest8764-21chrt07:24:333
166899483,34cyclictest11777-21chrt07:34:173
166899483,33cyclictest5143-21chrt08:49:523
166899482,35cyclictest12551-21chrt07:34:453
1668994614,19cyclictest0-21swapper/309:04:163
1668994614,17cyclictest0-21swapper/308:44:153
166899402,26cyclictest21901-21taskset08:04:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional