You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 23:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Tue Jun 02, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
231009911439,9cyclictest0-21swapper/008:35:170
231009911243,60cyclictest28498-21latency_hist07:14:580
231009911243,60cyclictest28498-21latency_hist07:14:580
231009911240,7cyclictest0-21swapper/012:15:300
231009911236,8cyclictest0-21swapper/011:34:560
231009911140,8cyclictest0-21swapper/008:04:540
231009911140,8cyclictest0-21swapper/008:04:540
231009910938,8cyclictest0-21swapper/008:05:340
1346421090,6sleep30-21swapper/311:11:453
231009910840,8cyclictest0-21swapper/009:01:160
231009910836,8cyclictest0-21swapper/009:50:030
23100991082,41cyclictest31659-21apt-get09:55:050
23100991082,41cyclictest31659-21apt-get09:55:050
231009910738,8cyclictest0-21swapper/007:51:340
231009910738,8cyclictest0-21swapper/007:51:340
231009910645,55cyclictest297-21systemd-logind08:44:550
23104991052,61cyclictest32463-21apt-get10:50:161
231009910547,51cyclictest3751-21ssh11:50:150
231009910441,14cyclictest330-21sh10:50:370
231009910438,8cyclictest0-21swapper/008:34:550
231009910332,9cyclictest0-21swapper/012:29:560
231099910146,50cyclictest22750-21kworker/u18:1+events_unbound10:39:542
231009910143,53cyclictest23091-21cyclictest10:25:120
231009910143,11cyclictest5871-21ssh10:59:580
231009910136,8cyclictest0-21swapper/007:45:170
23100991013,27cyclictest14132-21ssh09:26:060
23100991013,27cyclictest14132-21ssh09:26:060
231009910039,12cyclictest16912-21switchtime08:15:300
231009910034,59cyclictest0-21swapper/012:05:120
231009910027,19cyclictest0-21swapper/010:30:180
23100999938,9cyclictest11052-21rm12:01:500
23100999931,12cyclictest0-21swapper/009:34:570
23100999926,20cyclictest0-21swapper/011:39:540
2310099992,23cyclictest20810-21head09:35:320
23104999848,44cyclictest1-21systemd09:01:151
23100999836,8cyclictest0-21swapper/011:19:180
23100999823,21cyclictest4155-21idleruntime-cro07:39:540
23100999740,9cyclictest7612-21sh09:15:080
2310099972,25cyclictest14113-21seq11:13:360
2310099972,21cyclictest28917-21latency_hist10:44:570
2310099972,21cyclictest24154-21latency_hist12:24:560
23100999717,24cyclictest9053-21sh11:05:110
23104999644,45cyclictest30534-21diskmemload10:00:451
2310099963,41cyclictest6648-21rm09:13:090
2310099963,36cyclictest11656-21fschecks_time10:15:170
23109999544,14cyclictest31191-21sh09:54:302
2310099953,25cyclictest352-21runrttasks08:48:110
2310099953,25cyclictest352-21runrttasks08:48:110
2310099952,40cyclictest26828-21rm09:45:380
2310099952,40cyclictest26828-21rm09:45:380
2310099952,35cyclictest15470-21ssh12:10:070
2310099952,35cyclictest15470-21ssh12:10:070
23100999518,24cyclictest30242-21fschecks_count11:40:150
23104999443,44cyclictest18390-21/usr/sbin/munin12:15:181
23104999422,34cyclictest23775-21latency10:35:211
2310099945,42cyclictest10826-21cut09:20:150
23100999438,19cyclictest1839-21kworker/u17:1+nfsiod11:46:420
23104999338,47cyclictest0-21swapper/109:50:251
23100999337,8cyclictest0-21swapper/007:05:000
23104999245,39cyclictest2374-21systemd-journal09:09:581
23100999236,9cyclictest22718-21sh09:40:070
2310099922,40cyclictest24675-21ssh10:36:180
2310099922,33cyclictest30957-21sh10:47:180
23104999176,8cyclictest0-21swapper/109:25:321
23104999176,8cyclictest0-21swapper/109:25:321
23100999136,10cyclictest20189-21ssh11:23:180
23100999135,10cyclictest9844-21ssh10:11:290
23104999035,46cyclictest0-21swapper/111:39:551
23104999015,28cyclictest4212-21latency_hist07:39:561
23104998838,42cyclictest11671-21open_files08:00:231
23104998838,42cyclictest11671-21open_files08:00:231
23104998837,40cyclictest0-21swapper/108:40:291
23104998828,9cyclictest0-21swapper/109:40:151
23104998739,41cyclictest8679-21fschecks_time10:10:161
23104998739,41cyclictest30123-21unixbench_singl08:55:291
23104998737,43cyclictest0-21swapper/112:20:331
23104998733,46cyclictest0-21swapper/109:24:561
23104998731,48cyclictest0-21swapper/111:45:191
23104998731,48cyclictest0-21swapper/107:45:311
23104998728,8cyclictest0-21swapper/110:28:541
2310499872,25cyclictest23107-21latency_hist06:59:581
2310099873,23cyclictest2661-21apt-config07:34:580
23104998641,38cyclictest2276-21open_inodes09:05:281
23104998641,38cyclictest2276-21open_inodes09:05:281
23104998635,44cyclictest27330-21sh09:47:041
23104998635,44cyclictest27330-21sh09:47:041
23104998635,43cyclictest0-21swapper/111:21:301
23104998632,48cyclictest0-21swapper/108:15:191
23104998629,8cyclictest0-21swapper/107:10:271
23104998629,8cyclictest0-21swapper/107:10:271
23104998627,9cyclictest0-21swapper/111:05:091
23104998626,12cyclictest0-21swapper/108:35:121
23104998621,21cyclictest8708-21wc07:51:461
23104998621,21cyclictest8708-21wc07:51:461
23100998640,9cyclictest8495-21ssh11:58:000
2241428613,39sleep20-21swapper/206:55:392
23104998535,43cyclictest0-21swapper/108:20:181
23104998535,43cyclictest0-21swapper/108:20:181
2310499853,25cyclictest15670-21cut12:10:151
2310499853,25cyclictest15670-21cut12:10:151
23104998527,9cyclictest0-21swapper/111:50:261
23104998527,8cyclictest0-21swapper/111:42:131
23104998522,10cyclictest0-21swapper/107:29:581
23104998518,22cyclictest13343-21sh10:17:581
2310099852,27cyclictest352-21runrttasks08:58:200
23104998439,38cyclictest30534-21diskmemload10:07:271
23104998428,9cyclictest0-21swapper/108:50:281
23104998428,8cyclictest0-21swapper/111:55:221
23104998428,8cyclictest0-21swapper/111:15:181
23104998428,11cyclictest0-21swapper/108:30:321
23104998425,9cyclictest0-21swapper/112:05:141
23104998367,9cyclictest0-21swapper/111:14:561
2310499832,67cyclictest12966-21apt-get08:05:141
23104998320,8cyclictest0-21swapper/110:55:221
23104998319,21cyclictest25104-21cat07:05:031
23104998311,23cyclictest25256-21cat12:25:301
23100998362,12cyclictest0-21swapper/007:40:300
23100998360,13cyclictest0-21swapper/007:24:570
23104998234,40cyclictest0-21swapper/111:00:071
23104998136,40cyclictest0-21swapper/107:30:311
23104998135,39cyclictest30534-21diskmemload09:57:461
23104998135,39cyclictest30534-21diskmemload09:57:461
23104998135,39cyclictest0-21swapper/108:45:211
23104998135,39cyclictest0-21swapper/108:45:211
23104998133,41cyclictest0-21swapper/108:10:151
2310499813,28cyclictest30331-21/usr/sbin/munin10:45:321
2310499813,28cyclictest277-21dbus-daemon10:41:151
2310499813,25cyclictest352-21runrttasks09:15:271
2310499813,25cyclictest21624-21taskset09:37:451
2310499813,25cyclictest21471-21/usr/sbin/munin11:25:191
2310499813,25cyclictest21471-21/usr/sbin/munin11:25:191
23104998128,8cyclictest0-21swapper/111:30:361
23104998128,47cyclictest0-21swapper/110:20:281
23104998126,8cyclictest0-21swapper/109:30:231
23104998124,8cyclictest0-21swapper/110:33:461
2310499812,22cyclictest30392-21fschecks_count07:20:161
23104998027,47cyclictest0-21swapper/107:55:001
23104998017,20cyclictest5977-21latency_hist07:44:581
23100998023,20cyclictest24571-21kworker/u17:2+nfsiod11:02:470
23109997961,12cyclictest24645-21ntp_kernel_err11:30:222
2310499793,22cyclictest19430-21apt-get08:25:101
23104997927,8cyclictest0-21swapper/111:59:571
23100997960,8cyclictest0-21swapper/006:59:590
23109997856,15cyclictest544-21cron09:34:542
2310499783,22cyclictest28563-21/usr/sbin/munin07:15:101
2310499783,22cyclictest28563-21/usr/sbin/munin07:15:101
23109997744,10cyclictest4037-21ssh09:09:152
23109997744,10cyclictest4037-21ssh09:09:152
2310499773,23cyclictest23526-21fschecks_time07:00:171
23100997757,13cyclictest300-21rs:main0
23100997749,21cyclictest29355-21timerandwakeup07:15:290
23100997749,21cyclictest29355-21timerandwakeup07:15:290
23109997559,9cyclictest0-21swapper/209:55:312
23109997559,9cyclictest0-21swapper/209:55:312
23109997559,10cyclictest30534-21diskmemload09:10:372
23109997533,35cyclictest16598-21kworker/u17:0+xprtiod11:35:272
23100997561,8cyclictest0-21swapper/007:55:150
23100997559,10cyclictest0-21swapper/009:05:230
23100997559,10cyclictest0-21swapper/009:05:230
23109997455,13cyclictest6783-21threads07:45:302
23100997449,17cyclictest17138-21latency_hist10:24:560
23100997432,11cyclictest181rcu_preempt10:00:270
223492740,11sleep0161ktimers/011:26:000
223492740,11sleep0161ktimers/011:26:000
23109997355,12cyclictest2374-21systemd-journal10:30:142
23100997355,12cyclictest15364-21threads08:10:270
23109997254,12cyclictest277-21dbus-daemon11:49:552
23109997235,8cyclictest39-21ksoftirqd/207:17:102
23109997235,8cyclictest39-21ksoftirqd/207:17:102
23109997157,10cyclictest23091-21cyclictest10:21:542
2311899702,27cyclictest1631-21chrt09:05:083
2311899702,27cyclictest1631-21chrt09:05:083
2311899693,28cyclictest5785-21taskset10:05:303
2311899692,26cyclictest29665-21chrt09:50:313
2311899692,24cyclictest19371-21chrt12:15:283
23109996953,11cyclictest23091-21cyclictest11:17:312
2311899683,26cyclictest367-21taskset09:02:203
2311899683,26cyclictest16080-21chrt12:10:253
2311899683,26cyclictest16080-21chrt12:10:253
2311899683,26cyclictest15085-21chrt11:15:133
2311899682,28cyclictest4870-21chrt07:40:223
2311899682,28cyclictest22495-21chrt10:33:353
2311899682,28cyclictest19915-21taskset10:29:463
2311899682,27cyclictest16795-21taskset09:30:083
23109996854,8cyclictest0-21swapper/212:20:302
23109996853,10cyclictest23283-21/usr/sbin/munin07:00:232
23109996852,10cyclictest22525-21wc09:39:572
23109996850,11cyclictest18755-21idleruntime12:15:152
23109996848,12cyclictest27241-21fschecks_time07:10:172
23109996848,12cyclictest27241-21fschecks_time07:10:172
23109996847,15cyclictest4686-21sh11:50:382
2310999682,30cyclictest352-21runrttasks10:49:552
2311899673,26cyclictest773-21chrt07:29:573
2311899673,24cyclictest22920-21taskset11:27:373
2311899673,24cyclictest22920-21taskset11:27:373
2311899672,27cyclictest24106-21chrt11:30:093
2311899672,27cyclictest12989-21chrt08:05:173
2311899672,26cyclictest32610-21chrt11:44:443
2311899672,25cyclictest25907-21taskset08:44:583
2311899672,25cyclictest25907-21taskset08:44:583
2311899672,25cyclictest18784-21taskset11:21:213
23109996754,9cyclictest23091-21cyclictest10:03:452
23109996753,9cyclictest30231-21kworker/u17:0+xprtiod09:40:212
23109996751,10cyclictest9495-21/usr/sbin/munin07:55:222
23109996748,13cyclictest30942-21threads07:20:292
23109996735,23cyclictest26677-21modprobe07:09:542
23100996751,9cyclictest0-21swapper/008:25:270
230162679,36sleep30-21swapper/306:59:563
2311899663,24cyclictest25447-21taskset07:05:143
2311899662,26cyclictest14618-21taskset08:10:073
23109996650,9cyclictest0-21swapper/209:20:222
23109996649,12cyclictest297-21systemd-logind09:19:562
23109996649,11cyclictest1-21systemd11:13:422
23109996644,16cyclictest544-21cron08:24:532
23109996644,16cyclictest544-21cron08:24:532
23109996635,22cyclictest30476-21cat11:40:202
23100996651,9cyclictest0-21swapper/008:50:170
2311899653,28cyclictest28184-21chrt09:49:293
2311899653,28cyclictest28184-21chrt09:49:293
2311899653,26cyclictest24829-21chrt07:04:573
2311899653,26cyclictest16525-21taskset10:23:343
2311899653,25cyclictest24096-21taskset08:39:563
2311899653,24cyclictest4091-21chrt07:39:163
2311899652,27cyclictest5991-21chrt09:11:163
2311899652,27cyclictest11415-21chrt10:15:113
2311899652,26cyclictest14302-21taskset09:26:113
2311899652,26cyclictest14302-21taskset09:26:113
23109996551,10cyclictest23091-21cyclictest12:03:532
23109996549,10cyclictest1046-21runrttasks09:04:132
23109996544,14cyclictest14504-21fschecks_count09:26:362
23109996544,14cyclictest14504-21fschecks_count09:26:362
23100996544,15cyclictest6898-21ssh10:06:400
23109996448,10cyclictest25659-21/usr/sbin/munin09:45:232
23109996448,10cyclictest25659-21/usr/sbin/munin09:45:232
23109996444,14cyclictest2665-21sh10:54:582
23109996435,20cyclictest9164-21modprobe11:59:532
23109996433,22cyclictest21677-21find08:30:282
23100996447,11cyclictest1-21systemd08:24:150
23100996447,11cyclictest1-21systemd08:24:150
2311899633,27cyclictest14855-21taskset12:09:113
2311899632,29cyclictest5560-21chrt11:53:073
2311899632,28cyclictest10116-21chrt11:05:453
23109996348,10cyclictest24330-21apt08:40:072
23109996347,10cyclictest23091-21cyclictest12:07:462
23109996345,11cyclictest9051-21/usr/sbin/munin11:05:112
23109996344,14cyclictest30231-21kworker/u17:0+events_unbound08:59:542
23109996246,10cyclictest6557-21ntp_offset11:00:222
23109996241,13cyclictest13000-21cpu08:05:252
23109996231,21cyclictest26750-21sort10:40:202
23109996141,14cyclictest5884-21latency_hist07:44:572
23109996140,16cyclictest2697-21sh10:54:552
23109996139,16cyclictest544-21cron10:19:532
23109996045,8cyclictest0-21swapper/207:34:572
23109996044,9cyclictest20777-21modprobe08:29:542
2310999604,47cyclictest17357-21ssh10:25:112
23109996043,10cyclictest0-21swapper/211:21:342
23109996042,12cyclictest352-21runrttasks08:00:102
23109996042,12cyclictest352-21runrttasks08:00:102
23109996042,12cyclictest27325-21systemd-run08:49:552
23109996042,12cyclictest27325-21systemd-run08:49:552
23109996039,15cyclictest9273-21timerandwakeup10:10:302
2311899593,25cyclictest2167-21taskset07:33:173
23109995944,8cyclictest0-21swapper/212:10:262
23109995944,8cyclictest0-21swapper/212:10:262
23109995943,12cyclictest23091-21cyclictest10:06:482
23109995943,10cyclictest3085-21fschecks_time07:35:492
23109995942,9cyclictest0-21swapper/212:25:312
23109995942,11cyclictest31989-21fschecks_count07:25:172
23109995939,11cyclictest22112-21unixbench_multi11:25:322
23109995939,11cyclictest22112-21unixbench_multi11:25:322
2310999593,40cyclictest7896-21apt-get07:50:062
2310999593,40cyclictest7896-21apt-get07:50:062
2311899582,27cyclictest21487-21taskset09:37:223
23100995842,11cyclictest24090-21timerandwakeup07:00:300
2310999574,34cyclictest17555-21latency_hist08:19:572
2310999563,29cyclictest22648-21/usr/sbin/munin08:35:292
23109995537,12cyclictest0-21swapper/208:50:162
23109995338,8cyclictest0-21swapper/208:10:282
2311899473,31cyclictest32610-21taskset10:50:293
23118994729,11cyclictest89142sleep310:10:213
2311899463,31cyclictest7222-21chrt11:00:593
2311899463,30cyclictest28585-21taskset07:15:063
2311899463,30cyclictest28585-21taskset07:15:063
2311899453,31cyclictest1834-21chrt09:59:513
2311899453,31cyclictest1834-21chrt09:59:513
2311899453,31cyclictest13213-21taskset09:24:533
2311899453,30cyclictest26611-21taskset12:28:453
2311899453,30cyclictest24650-21taskset10:36:143
2311899453,29cyclictest12396-21chrt08:04:153
2311899453,29cyclictest12396-21chrt08:04:153
2311899452,30cyclictest7593-21taskset09:15:043
2311899443,30cyclictest23111-21taskset09:40:173
2311899443,29cyclictest7873-21taskset07:50:023
2311899443,29cyclictest7873-21taskset07:50:023
2311899443,28cyclictest29594-21chrt10:45:183
2311899443,28cyclictest21068-21taskset08:30:083
2311899442,31cyclictest27070-21taskset11:35:073
2311899442,30cyclictest21572-21taskset12:20:143
2311899442,30cyclictest1920-21chrt11:46:183
2311899433,29cyclictest8116-21chrt11:56:553
2311899433,29cyclictest30484-21taskset08:59:363
2311899433,28cyclictest28014-21chrt08:50:213
2311899433,28cyclictest18484-21taskset08:20:283
2311899433,28cyclictest18484-21taskset08:20:283
2311899433,27cyclictest9763-21taskset12:00:163
2311899433,27cyclictest6188-21taskset07:45:163
2311899432,30cyclictest3185-21taskset10:55:153
2311899424,28cyclictest9521-21taskset07:55:083
2311899423,28cyclictest3211-21taskset10:00:523
2311899423,28cyclictest20826-21chrt08:29:553
2311899423,27cyclictest16754-21chrt08:15:253
2311899422,30cyclictest27874-21taskset10:41:583
2311899422,28cyclictest27119-21taskset07:10:123
2311899422,28cyclictest27119-21taskset07:10:123
2311899422,27cyclictest30195-21taskset07:20:083
2311899412,27cyclictest24466-21taskset08:40:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional