You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 05:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Jun 10, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68319911321,46cyclictest0-21swapper/021:05:300
68319911321,46cyclictest0-21swapper/021:05:300
6842999854,9cyclictest181rcu_preempt21:05:292
6842999854,9cyclictest181rcu_preempt21:05:292
683699973,47cyclictest25437-21apt-get19:54:341
6831999765,27cyclictest2628-21kworker/u19:3-events_unbound23:54:490
6831999725,28cyclictest11623-21ntp_states20:51:060
6831999725,28cyclictest11623-21ntp_states20:51:060
540929710,61sleep25461-21expr18:54:442
683699966,28cyclictest1375-21ssh23:19:341
6842999572,16cyclictest6819-21cyclictest22:40:002
6831999414,63cyclictest10060-21apt-get23:34:380
6836999348,37cyclictest0-21swapper/121:05:371
6836999348,37cyclictest0-21swapper/121:05:371
6831999317,44cyclictest1180-21/usr/sbin/munin22:24:470
64952936,64sleep10-21swapper/118:57:041
6831999259,26cyclictest21745-21latency_hist22:59:270
6831999223,30cyclictest22191-21apt-get19:44:390
6836999150,34cyclictest0-21swapper/123:31:541
683699913,37cyclictest31498-21latency_hist00:09:271
683699913,37cyclictest31498-21latency_hist00:09:271
6831999120,28cyclictest24905-21/usr/sbin/munin23:04:410
6836999033,52cyclictest0-21swapper/122:14:261
6831999022,29cyclictest25302-21/usr/sbin/munin22:10:010
6831999018,38cyclictest4178-21taskset00:17:360
6831998914,44cyclictest28239-21interrupts23:09:490
6831998914,44cyclictest28239-21interrupts23:09:490
597328941,26sleep015-21ksoftirqd/018:55:070
6842998871,11cyclictest898-21cpuspeed22:24:392
683699883,30cyclictest13923-21cron20:59:231
6831998824,28cyclictest9113-21apt-get20:44:390
6831998813,42cyclictest8366-21cat23:30:000
6842998766,14cyclictest13949-21diskmemload21:45:012
683699874,37cyclictest30835-21ntpq22:19:521
683699874,37cyclictest30835-21ntpq22:19:521
683699873,35cyclictest352-21runrttasks20:03:031
683699864,40cyclictest25293-21ssh23:59:241
683699864,37cyclictest11977-21latency_hist21:49:271
683699864,35cyclictest12295-21grep21:49:441
683699863,39cyclictest989-21timerwakeupswit21:30:001
683699863,36cyclictest6760-21find21:39:561
683699863,36cyclictest6760-21find21:39:561
683699863,36cyclictest24577-21find19:49:581
683699863,35cyclictest10657-21latency_hist19:09:271
6831998625,35cyclictest15902-21seq19:24:460
6831998625,35cyclictest15902-21seq19:24:460
6831998624,20cyclictest31387-21awk23:14:510
6831998612,48cyclictest13985-21systemd-run20:59:250
6842998553,10cyclictest181rcu_preempt00:16:452
683699854,35cyclictest18822-21/usr/sbin/munin22:54:561
683699854,34cyclictest7623-21sendmail_mailqu18:59:551
683699853,39cyclictest2374-21systemd-journal22:34:241
683699853,38cyclictest13153-21cut22:44:481
683699853,38cyclictest12631-21wc19:14:401
6831998523,18cyclictest352-21runrttasks22:34:350
6831998513,54cyclictest9825-21apt-get22:39:350
6831998510,54cyclictest6839-21ssh23:28:510
6842998448,11cyclictest181rcu_preempt20:44:262
683699845,37cyclictest30092-21sh22:19:271
683699844,38cyclictest10612-21apt-get23:34:571
683699844,37cyclictest31595-21/usr/sbin/munin00:09:461
683699844,35cyclictest26759-21fschecks_count21:19:501
683699844,33cyclictest352-21runrttasks22:28:201
683699843,28cyclictest7229-21modprobe20:39:241
683699843,18cyclictest31259-21unixbench_singl20:10:001
683699842,42cyclictest26720-21taskset00:00:021
6831998462,15cyclictest20848-21apt-key22:04:270
683199843,67cyclictest30550-21unixbench_singl21:25:010
6831998425,37cyclictest24642-21timerwakeupswit19:49:590
6831998424,24cyclictest28337-21/usr/sbin/munin22:15:010
6831998419,30cyclictest2638-21/usr/sbin/munin20:24:410
6831998418,28cyclictest17247-21ssh21:58:040
6831998413,25cyclictest0-21swapper/023:24:080
6842998362,13cyclictest4350-21cpuspeed20:29:402
683699834,36cyclictest7047-21sendmail23:29:241
683699834,34cyclictest15805-21cpuspeed19:24:421
683699834,34cyclictest15805-21cpuspeed19:24:421
683699834,33cyclictest352-21runrttasks20:25:021
683699833,39cyclictest4905-21grep20:29:561
683699833,39cyclictest21895-21tune2fs22:05:421
683699833,35cyclictest8662-21taskset00:24:491
683699833,30cyclictest15462-21modprobe19:24:241
6831998329,21cyclictest20744-21/usr/sbin/munin19:39:430
6831998323,24cyclictest10915-21rm21:47:110
6831998320,22cyclictest6988-21/usr/sbin/munin18:59:470
6831998318,23cyclictest27998-21ssh00:03:360
6831998317,28cyclictest12811-21/usr/sbin/munin22:44:350
6831998317,27cyclictest12641-21/usr/sbin/munin21:49:520
6831998315,29cyclictest26796-21basename19:59:240
6831998312,41cyclictest10773-21ssh00:29:190
6842998259,8cyclictest181rcu_preempt21:15:362
6842998259,17cyclictest30592-21fschecks_time22:19:462
6842998259,17cyclictest30592-21fschecks_time22:19:462
6842998215,47cyclictest21264-21apt-get22:04:422
683699824,35cyclictest22143-21fschecks_time22:59:461
683699824,35cyclictest22143-21fschecks_time22:59:461
683699823,39cyclictest14174-21ntpq23:39:521
683699823,37cyclictest6806-21/usr/sbin/munin22:34:521
683699823,37cyclictest18290-21tail19:30:001
683699823,37cyclictest18290-21tail19:30:001
683699823,34cyclictest9281-21fschecks_count20:44:451
683699823,29cyclictest20095-21grep23:49:501
683699823,26cyclictest8412-21grep20:40:001
6836998231,43cyclictest0-21swapper/121:09:461
683199827,57cyclictest21264-21apt-get22:04:500
6831998263,13cyclictest13979-21kworker/u18:0+events_unbound21:19:230
6831998231,22cyclictest7757-21fschecks_time20:39:460
6831998219,22cyclictest27905-21seq21:20:520
6831998218,28cyclictest14815-21/usr/sbin/munin19:19:580
6831998214,28cyclictest1-21systemd20:24:240
6842998155,20cyclictest20779-21fschecks_count21:09:462
6842998151,9cyclictest181rcu_preempt21:04:182
684299814,50cyclictest10980-21apt-get20:49:382
684299814,50cyclictest10980-21apt-get20:49:382
6842998135,13cyclictest181rcu_preempt23:35:482
6836998162,13cyclictest6819-21cyclictest21:29:271
683699814,37cyclictest3126-21ssh00:15:001
683699813,35cyclictest352-21runrttasks19:48:191
683699813,34cyclictest5126-21/usr/sbin/munin00:19:501
683699813,34cyclictest5126-21/usr/sbin/munin00:19:501
6836998132,41cyclictest0-21swapper/122:01:091
683699813,23cyclictest28811-21/usr/sbin/munin23:10:021
683699813,23cyclictest28811-21/usr/sbin/munin23:10:021
683699813,23cyclictest15093-21switchtime20:59:591
6836998131,43cyclictest0-21swapper/121:14:511
683699812,36cyclictest17228-21ssh23:44:551
683699812,36cyclictest17228-21ssh23:44:551
683699812,33cyclictest11500-21grep19:11:041
6831998120,36cyclictest20969-21seq23:50:390
6831998118,29cyclictest0-21swapper/022:29:470
6831998118,25cyclictest32452-21/usr/sbin/munin20:14:550
6831998118,24cyclictest5513-21ssh21:38:480
6831998116,28cyclictest15053-21grep20:59:580
6842998052,19cyclictest13949-21diskmemload22:37:102
6842998050,8cyclictest181rcu_preempt20:14:412
683699804,36cyclictest24797-21/usr/sbin/munin23:04:461
683699804,35cyclictest15819-21/usr/sbin/munin22:49:401
683699803,37cyclictest10879-21head22:40:001
683699803,34cyclictest1032-21/usr/sbin/munin20:19:531
683699802,24cyclictest29181-21seq20:04:511
6831998019,28cyclictest17573-21/usr/sbin/munin23:45:010
6831998019,28cyclictest17573-21/usr/sbin/munin23:45:010
6831998017,28cyclictest6463-21/usr/sbin/munin20:34:560
6831998016,29cyclictest27042-21apt19:59:350
6842997961,11cyclictest29964-21idleruntime-cro22:19:232
6842997958,17cyclictest6819-21cyclictest19:59:592
6842997958,13cyclictest2374-21systemd-journal22:54:382
6842997957,16cyclictest10845-21sendmail00:29:232
6842997953,9cyclictest181rcu_preempt21:34:272
684299792,53cyclictest10953-21runrttasks19:09:572
6836997945,28cyclictest300-21rs:main1
6836997945,28cyclictest300-21rs:main1
683699794,30cyclictest32068-21fschecks_count20:14:451
683699793,35cyclictest19696-21switchtime19:34:581
683699793,25cyclictest3779-21/usr/sbin/munin21:34:571
6836997927,44cyclictest0-21swapper/123:14:501
6836997927,44cyclictest0-21swapper/119:39:591
6836997922,47cyclictest0-21swapper/121:59:271
6831997919,27cyclictest17400-21ssh22:51:170
6831997919,23cyclictest31026-21ssh00:08:420
6831997919,23cyclictest31026-21ssh00:08:420
6831997918,24cyclictest31634-21apt20:14:230
6831997917,33cyclictest0-21swapper/021:39:430
6831997917,33cyclictest0-21swapper/021:39:430
6831997915,25cyclictest8616-21munin-node19:04:300
6831997912,27cyclictest17463-21awk19:29:410
6831997912,27cyclictest17463-21awk19:29:410
6842997852,16cyclictest32490-21timerandwakeup00:09:582
6842997845,10cyclictest181rcu_preempt19:14:292
6842997828,10cyclictest181rcu_preempt19:29:282
6842997828,10cyclictest181rcu_preempt19:29:282
6831997819,26cyclictest30410-21wc22:19:410
6831997819,26cyclictest30410-21wc22:19:410
6831997812,26cyclictest0-21swapper/021:11:220
6842997755,15cyclictest0-21swapper/219:04:302
6842997750,9cyclictest181rcu_preempt23:09:492
6842997750,9cyclictest181rcu_preempt23:09:492
6842997747,10cyclictest181rcu_preempt19:49:362
6842997742,13cyclictest181rcu_preempt20:24:312
6842997729,13cyclictest0-21swapper/223:32:042
6831997719,22cyclictest1949-21sh21:32:140
6831997715,21cyclictest0-21swapper/023:41:180
6831997712,25cyclictest13871-21latency_hist19:19:260
6842997656,15cyclictest6819-21cyclictest22:00:302
6842997654,15cyclictest14112-21latency23:39:502
6842997647,10cyclictest181rcu_preempt19:32:382
6842997647,10cyclictest181rcu_preempt19:32:382
684299763,28cyclictest26779-21latency_hist19:59:242
684299762,39cyclictest39-21ksoftirqd/200:03:182
6831997631,37cyclictest32217-21ntp_offset00:09:520
6842997552,16cyclictest13354-21threads20:54:592
6842997526,13cyclictest181rcu_preempt23:04:472
684299752,36cyclictest30198-21awk21:24:572
6831997559,10cyclictest5710-21rm00:19:520
6831997559,10cyclictest5710-21rm00:19:520
6831997531,38cyclictest0-21swapper/022:59:380
6831997531,38cyclictest0-21swapper/022:59:380
6831997520,25cyclictest18963-21/usr/sbin/munin19:34:440
6831997518,35cyclictest29718-21seq20:06:050
6842997455,11cyclictest18233-21ssh23:46:292
6842997455,11cyclictest18233-21ssh23:46:292
6842997440,13cyclictest181rcu_preempt23:58:292
6842997440,12cyclictest181rcu_preempt21:19:352
6842997436,14cyclictest181rcu_preempt22:29:432
6842997433,9cyclictest181rcu_preempt20:09:492
684299742,44cyclictest14541-21latency19:19:502
6842997424,10cyclictest0-21swapper/200:19:512
6842997424,10cyclictest0-21swapper/200:19:512
6831997413,24cyclictest4814-21cat20:29:520
6842997349,8cyclictest181rcu_preempt00:05:042
6842997349,8cyclictest181rcu_preempt00:05:042
6842997345,8cyclictest181rcu_preempt22:44:362
6842997342,8cyclictest181rcu_preempt22:10:302
6842997330,8cyclictest181rcu_preempt23:49:402
6842997328,12cyclictest181rcu_preempt21:49:452
6831997310,29cyclictest10901-21/usr/sbin/munin19:11:010
6842997240,10cyclictest181rcu_preempt19:01:302
6842997239,13cyclictest181rcu_preempt22:59:412
6842997239,13cyclictest181rcu_preempt22:59:412
6842997238,12cyclictest181rcu_preempt19:39:322
684299723,43cyclictest440-21kworker/u17:1+xprtiod21:59:272
6842997234,12cyclictest181rcu_preempt20:44:592
6842997232,12cyclictest181rcu_preempt21:37:252
6842997223,24cyclictest181rcu_preempt23:19:582
6842997138,11cyclictest181rcu_preempt20:05:282
6842997137,13cyclictest181rcu_preempt20:23:552
684299713,46cyclictest19241-21fschecks_time19:34:462
6842997134,21cyclictest0-21swapper/223:25:002
6842997046,8cyclictest181rcu_preempt22:49:402
6842996924,12cyclictest181rcu_preempt21:42:322
6842996924,12cyclictest181rcu_preempt21:42:322
6842996827,9cyclictest371rcuc/223:19:032
6849996713,31cyclictest0-21swapper/322:04:423
684299673,47cyclictest7233-21modprobe20:39:242
684999664,45cyclictest24331-21taskset19:49:523
6842996648,11cyclictest26887-21kworker/u17:3-ext4-rsv-conversion19:49:242
684999632,38cyclictest917-21kworker/3:1+events00:15:063
6849996313,22cyclictest0-21swapper/321:04:403
6849996313,22cyclictest0-21swapper/321:04:403
684999564,37cyclictest25847-21taskset23:59:453
684999564,35cyclictest24725-21chrt21:15:203
6849995638,10cyclictest60782sleep300:20:003
6849995638,10cyclictest60782sleep300:20:003
684999562,38cyclictest9523-21chrt00:25:473
684999562,37cyclictest917-21kworker/3:1+events22:44:573
684999553,38cyclictest16819-21chrt21:04:043
684999553,37cyclictest6442-21chrt22:34:153
684999553,36cyclictest29972-21chrt22:19:233
684999549,29cyclictest0-21swapper/321:59:273
684999543,39cyclictest21514-21chrt22:59:233
684999543,38cyclictest15848-21taskset23:43:123
684999543,30cyclictest917-21kworker/3:1+events00:04:413
684999543,30cyclictest917-21kworker/3:1+events00:04:413
684999542,37cyclictest15485-21taskset19:24:243
684999542,35cyclictest897-21chrt21:29:593
684999533,38cyclictest7300-21chrt18:59:463
684999533,37cyclictest20763-21chrt23:50:053
684999533,36cyclictest1693-21taskset23:19:463
684999533,36cyclictest10579-21chrt20:49:263
684999533,36cyclictest0-21swapper/323:35:403
684999533,35cyclictest1092-21chrt20:19:413
684999533,34cyclictest27627-21chrt21:20:063
684999533,33cyclictest917-21kworker/3:1+events21:50:553
684999532,38cyclictest18011-21chrt23:45:513
684999532,38cyclictest18011-21chrt23:45:513
684999524,33cyclictest32162-21chrt00:09:513
684999524,33cyclictest1163-21chrt22:24:463
684999523,38cyclictest4503-21chrt20:29:453
684999523,36cyclictest7636-21taskset20:39:423
684999523,36cyclictest19086-21chrt19:34:413
684999523,36cyclictest11909-21chrt19:11:123
684999523,35cyclictest22834-21chrt23:00:003
684999523,35cyclictest22834-21chrt23:00:003
684999523,33cyclictest16591-21chrt19:25:013
684999523,33cyclictest16591-21chrt19:25:013
684999523,33cyclictest13846-21chrt19:19:183
684999522,37cyclictest24601-21taskset22:09:473
684999522,35cyclictest31227-21chrt21:26:473
684999513,36cyclictest6834-21chrt22:34:353
684999513,36cyclictest30937-21chrt20:09:573
684999513,36cyclictest27435-21taskset23:09:163
684999513,33cyclictest27874-21chrt23:09:403
684999513,33cyclictest27874-21chrt23:09:403
684999513,31cyclictest25435-21chrt19:54:343
684999512,35cyclictest4420-21chrt23:24:403
684999503,36cyclictest9471-21chrt19:04:523
684999503,35cyclictest12324-21taskset20:54:243
684999503,35cyclictest12324-21taskset20:54:243
684999503,32cyclictest30219-21chrt22:19:273
684999503,32cyclictest30219-21chrt22:19:273
684999502,39cyclictest17668-21chrt22:52:023
684999502,36cyclictest10643-21taskset21:46:243
684999502,32cyclictest3194-21taskset21:34:413
684999493,34cyclictest7612-21chrt21:41:183
684999493,34cyclictest7612-21chrt21:41:183
684999493,33cyclictest18193-21chrt19:29:593
684999493,33cyclictest18193-21chrt19:29:593
684999493,32cyclictest6939-21chrt18:59:293
684999493,32cyclictest11210-21chrt22:40:473
684999492,31cyclictest28720-21chrt20:04:383
684999483,33cyclictest13093-21chrt20:54:533
684999483,31cyclictest27549-21chrt19:59:523
684999483,30cyclictest20605-21chrt21:09:403
684999482,34cyclictest7368-21chrt23:29:343
684999482,33cyclictest23765-21chrt19:49:273
684999473,30cyclictest18321-21taskset21:59:463
684999463,30cyclictest32049-21chrt20:14:433
684999443,30cyclictest31031-21taskset23:14:433
684999442,25cyclictest5905-21taskset20:34:393
684999433,29cyclictest24448-21chrt23:57:023
684999412,26cyclictest2663-21taskset20:24:393
684999402,29cyclictest21759-21chrt19:42:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional