You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 17:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sat Apr 25, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2207211810,76sleep22240-21proc_pri06:58:102
2989211311,67sleep12991-21apt-get07:02:291
32699910859,42cyclictest16251-21sendmail11:52:262
295721076,16sleep00-21swapper/007:02:200
3269991065,88cyclictest18730-21apt-get07:47:412
32699910414,71cyclictest30239-21taskset10:27:492
32699910414,71cyclictest30239-21taskset10:27:492
32609910038,54cyclictest0-21swapper/110:03:011
3269999933,29cyclictest0-21swapper/212:17:222
3260999938,9cyclictest0-21swapper/109:03:051
3260999938,9cyclictest0-21swapper/109:03:051
326099993,70cyclictest32142-21ssh12:17:511
3260999730,15cyclictest0-21swapper/112:02:481
3260999730,15cyclictest0-21swapper/112:02:481
3260999650,39cyclictest27828-21latency_hist11:17:291
3260999638,12cyclictest22599-21kworker/u17:1-rpciod09:32:511
3260999638,12cyclictest22599-21kworker/u17:1-rpciod09:32:511
3260999578,11cyclictest30242-21sh10:27:501
3260999578,11cyclictest30242-21sh10:27:501
3260999538,11cyclictest0-21swapper/112:22:521
3260999537,50cyclictest0-21swapper/108:57:501
3260999537,13cyclictest14575-21kworker/u17:0+events_unbound10:09:261
3260999536,16cyclictest8743-21latency_hist07:17:311
326099953,36cyclictest6440-21grep07:08:061
3260999526,13cyclictest0-21swapper/111:42:521
3260999526,13cyclictest0-21swapper/111:42:521
328399945,76cyclictest30214-21taskset10:27:463
328399945,76cyclictest30214-21taskset10:27:463
3260999437,12cyclictest0-21swapper/109:48:051
3260999429,11cyclictest0-21swapper/110:57:501
3269999332,49cyclictest0-21swapper/210:07:312
326999932,60cyclictest10886-21seq10:48:472
3260999333,9cyclictest0-21swapper/111:58:571
3260999332,13cyclictest0-21swapper/110:42:291
3269999210,46cyclictest0-21swapper/211:42:262
3260999229,15cyclictest0-21swapper/109:52:541
3260999229,15cyclictest0-21swapper/109:52:541
326099922,47cyclictest19631-21ntp_states11:03:001
326099922,38cyclictest23647-21apt-config08:02:311
3260999218,33cyclictest17653-21sh11:53:411
326099913,39cyclictest1486-21latency_hist11:27:311
326099913,37cyclictest10433-21apt-get07:22:401
326099913,36cyclictest29126-21fschecks_count08:17:501
326099913,34cyclictest8917-21grep08:53:031
326099913,34cyclictest30627-21cstates08:22:451
326099913,34cyclictest30627-21cstates08:22:451
326099912,37cyclictest21260-21grep07:53:051
326099903,43cyclictest839-21cat08:28:551
326099903,42cyclictest26273-21/usr/sbin/munin09:28:011
326099903,40cyclictest23806-21/usr/sbin/munin08:04:101
326099903,38cyclictest28138-21timerwakeupswit08:13:051
326099903,35cyclictest6108-21modprobe08:47:271
326099903,35cyclictest18454-21cat07:47:301
3260999026,19cyclictest0-21swapper/109:58:001
3250999040,9cyclictest181rcu_preempt11:37:380
326999893,68cyclictest32067-21apt-get12:17:512
326099897,44cyclictest10019-21rm10:47:451
326099894,37cyclictest5126-21diskmemload11:32:541
326099894,37cyclictest5126-21diskmemload11:32:541
3260998937,44cyclictest0-21swapper/111:12:311
3260998937,44cyclictest0-21swapper/111:12:311
326099893,37cyclictest18934-21grep07:48:081
326099893,32cyclictest15132-21latency_hist07:37:301
326099893,32cyclictest15132-21latency_hist07:37:301
3260998928,12cyclictest0-21swapper/107:22:111
3269998819,34cyclictest10981-21diskmemload09:50:132
326099884,32cyclictest25649-21/usr/sbin/munin08:07:391
326099884,32cyclictest25649-21/usr/sbin/munin08:07:391
326099883,34cyclictest352-21runrttasks10:15:381
326099883,34cyclictest352-21runrttasks10:15:381
326099883,32cyclictest12452-21latency07:27:551
326099882,28cyclictest13625-21rm10:52:591
326999872,53cyclictest9104-21seq10:46:362
326999872,53cyclictest9104-21seq10:46:362
326999872,46cyclictest31509-21ssh11:22:532
326099874,35cyclictest20296-21/usr/sbin/munin09:18:041
326099873,38cyclictest1349-21ntp_offset10:32:571
326099873,35cyclictest10176-21rm11:42:171
326099873,33cyclictest1778-21fschecks_time08:32:491
3260998732,12cyclictest0-21swapper/109:23:051
326099872,37cyclictest29127-21fschecks_time12:12:491
326099872,33cyclictest352-21runrttasks12:07:571
3250998750,9cyclictest181rcu_preempt12:02:400
3250998750,9cyclictest181rcu_preempt12:02:400
3269998645,36cyclictest0-21swapper/211:12:272
3269998645,36cyclictest0-21swapper/211:12:272
3269998641,37cyclictest0-21swapper/210:55:082
326099864,35cyclictest3435-21fschecks_time08:37:511
326099863,35cyclictest15262-21/usr/sbin/munin07:37:461
326099863,35cyclictest15262-21/usr/sbin/munin07:37:461
326099863,31cyclictest352-21runrttasks11:20:081
326099854,32cyclictest6089-21latency12:27:541
326099854,32cyclictest6089-21latency12:27:541
326099853,34cyclictest7571-21switchtime10:43:021
326099853,34cyclictest7571-21switchtime10:43:021
3269998462,16cyclictest18231-21munin-plugin-st07:47:292
3269998418,56cyclictest16821-21apt-get11:52:452
326099844,37cyclictest3670-21cat07:03:041
3250998445,12cyclictest181rcu_preempt09:22:410
3250998440,33cyclictest1-21systemd10:32:280
3250998440,33cyclictest1-21systemd10:32:280
3269998325,30cyclictest0-21swapper/209:37:462
326099833,34cyclictest7920-21latency_hist08:52:311
326099833,33cyclictest14305-21mailstats11:48:011
3250998360,17cyclictest7652-21sh10:43:030
3250998360,17cyclictest7652-21sh10:43:030
3250998360,15cyclictest20688-21ssh10:12:290
3269998236,39cyclictest0-21swapper/211:27:452
326999822,70cyclictest28525-21sendmail12:12:272
326099823,37cyclictest352-21runrttasks10:22:581
326099823,35cyclictest2862-21/usr/sbin/munin09:43:071
3250998244,30cyclictest19676-21snmpd11:32:290
325099823,41cyclictest29975-21mktemp10:27:310
3269998151,21cyclictest10355-21switchtime08:58:032
326999812,67cyclictest0-21swapper/210:32:412
326999812,64cyclictest0-21swapper/207:22:432
326099814,32cyclictest352-21runrttasks09:39:101
3250998149,23cyclictest11155-21latency_hist09:02:300
3250998145,27cyclictest8240-21grep08:52:490
3269998029,43cyclictest0-21swapper/212:02:262
3269998029,42cyclictest0-21swapper/208:17:502
325099807,59cyclictest32096-21ssh12:17:430
3250998061,11cyclictest4582-21latency_hist08:42:300
3250998057,17cyclictest20621-21fschecks_time07:52:510
3250998050,21cyclictest18460-21apt-key07:47:300
3269997953,19cyclictest14274-21/usr/sbin/munin09:07:532
326999794,67cyclictest0-21swapper/211:32:382
326999794,67cyclictest0-21swapper/211:32:382
3269997933,40cyclictest0-21swapper/210:27:302
3269997932,39cyclictest0-21swapper/210:17:292
3269997932,39cyclictest0-21swapper/210:17:292
3269997927,46cyclictest0-21swapper/212:22:502
326999792,67cyclictest20318-21apt-get09:17:392
3250997956,14cyclictest4840-21ssh12:26:130
3250997947,11cyclictest181rcu_preempt10:17:450
328399783,37cyclictest32154-21chrt12:17:533
326999784,59cyclictest0-21swapper/207:57:402
3269997841,30cyclictest10981-21diskmemload11:00:152
3250997857,15cyclictest298-21in:imuxsock07:07:290
3250997857,13cyclictest11963-21ssh09:03:000
3250997857,13cyclictest11963-21ssh09:03:000
3269997753,15cyclictest352-21runrttasks12:28:032
3269997753,15cyclictest352-21runrttasks12:28:032
3269997749,17cyclictest0-21swapper/211:17:272
326999772,66cyclictest12801-21ls09:58:022
326999772,42cyclictest10981-21diskmemload09:03:452
326999772,42cyclictest10981-21diskmemload09:03:452
3269997719,46cyclictest0-21swapper/210:37:502
326099773,34cyclictest18177-21sed09:13:041
3250997752,17cyclictest30551-21ssh12:14:470
3250997738,16cyclictest181rcu_preempt11:47:490
3250997736,29cyclictest28861-21sort11:18:020
326999763,61cyclictest1553-21apt-get08:32:432
3269997632,35cyclictest0-21swapper/207:52:542
326999762,61cyclictest0-21swapper/208:12:442
3260997658,11cyclictest24913-21sh10:18:051
3250997660,10cyclictest3226-21cyclictest08:22:490
3250997660,10cyclictest3226-21cyclictest08:22:490
3250997636,31cyclictest0-21swapper/011:57:380
3250997630,32cyclictest922-21grep08:28:560
326999753,67cyclictest0-21swapper/209:12:422
326999753,65cyclictest0-21swapper/207:32:392
326999753,65cyclictest0-21swapper/207:32:392
3269997534,34cyclictest28781-21mailstats11:18:012
3269997532,36cyclictest0-21swapper/209:42:482
3269997531,37cyclictest0-21swapper/209:27:462
326999752,63cyclictest4775-21apt-get08:42:392
325099756,59cyclictest9969-21apt-get10:47:420
3250997542,24cyclictest6472-21systemctl10:42:280
3269997458,10cyclictest23874-21ntp_kernel_err09:22:572
326999743,62cyclictest2991-21apt-get07:02:472
326999743,59cyclictest0-21swapper/208:47:422
326999743,54cyclictest23825-21apt-get08:03:132
3250997454,15cyclictest26030-21kworker/u17:3+rpciod09:43:050
3250997454,11cyclictest0-21swapper/007:07:520
3250997453,13cyclictest15205-21ssh10:02:500
325099745,15cyclictest10981-21diskmemload11:47:290
325099745,15cyclictest10981-21diskmemload11:47:290
325099744,44cyclictest18730-21apt-get07:47:500
325099743,38cyclictest14560-21fschecks_count09:07:500
326999733,64cyclictest0-21swapper/208:37:432
3250997354,11cyclictest3751-21kworker/u17:0+rpciod11:14:560
3250997350,14cyclictest20880-21ssh10:12:320
3250997350,14cyclictest20880-21ssh10:12:320
325099733,49cyclictest352-21runrttasks11:05:090
3269997250,15cyclictest13422-21latency_hist11:47:302
3269997250,15cyclictest13422-21latency_hist11:47:302
326999723,62cyclictest0-21swapper/207:37:402
326999723,62cyclictest0-21swapper/207:37:402
326999723,60cyclictest23620-21/usr/sbin/munin12:03:012
326999723,60cyclictest23620-21/usr/sbin/munin12:03:012
3269997228,37cyclictest7213-21acpi07:12:392
326999722,60cyclictest29314-21apt-get09:32:392
326999722,60cyclictest29314-21apt-get09:32:392
326999722,53cyclictest9467-21sed08:57:292
3269997220,45cyclictest12256-21cut07:27:512
3250997258,10cyclictest3226-21cyclictest09:17:450
325099725,36cyclictest4567-21/usr/sbin/munin11:33:000
325099725,36cyclictest4567-21/usr/sbin/munin11:33:000
3250997247,16cyclictest12479-21ssh09:57:550
325099724,35cyclictest22893-21timerandwakeup11:08:040
325099724,35cyclictest22893-21timerandwakeup11:08:040
325099723,34cyclictest13774-21cstates07:32:440
325099723,34cyclictest13774-21cstates07:32:440
328399713,25cyclictest17993-21chrt09:13:013
326999713,47cyclictest25166-21apt-get08:07:432
326999713,47cyclictest25166-21apt-get08:07:432
326999712,61cyclictest21816-21latency_hist11:07:302
3260997154,12cyclictest3226-21cyclictest11:28:091
325099714,36cyclictest7764-21grep08:52:280
3250997139,23cyclictest1-21systemd09:48:020
325099713,35cyclictest5936-21fschecks_time12:27:510
325099713,35cyclictest5936-21fschecks_time12:27:510
328399702,33cyclictest10276-21taskset11:42:273
328399702,30cyclictest5777-21chrt11:33:193
328399702,30cyclictest5777-21chrt11:33:193
326999703,61cyclictest0-21swapper/207:17:412
326999703,58cyclictest24594-21/usr/sbin/munin10:18:002
326999703,54cyclictest31920-21apt-config08:27:282
326999703,54cyclictest31920-21apt-config08:27:282
3269997026,37cyclictest19380-21sh10:09:082
326999702,57cyclictest32367-21apt-get08:28:312
325099704,32cyclictest31803-21switchtime11:23:010
328399693,32cyclictest3341-21taskset10:37:143
328399693,30cyclictest3008-21chrt09:42:483
328399693,27cyclictest12123-21chrt10:51:013
326999693,56cyclictest9713-21switchtime09:53:022
326999693,56cyclictest9713-21switchtime09:53:022
3250996940,20cyclictest11577-21modprobe09:57:270
3250996940,20cyclictest11577-21modprobe09:57:270
3250996939,9cyclictest181rcu_preempt09:27:390
325099693,34cyclictest20270-21latency11:57:530
326999683,57cyclictest6031-21memory07:07:572
325099684,38cyclictest16473-21sed10:57:540
3250996837,22cyclictest0-21swapper/008:22:300
325099683,53cyclictest1052-21fschecks_time10:32:510
325099683,38cyclictest32293-21/usr/sbin/munin09:38:000
328399673,27cyclictest26500-21chrt09:27:493
328399673,21cyclictest26602-21chrt08:08:243
328399673,21cyclictest26602-21chrt08:08:243
3260996744,16cyclictest14381-21cpuspeed09:07:441
3250996737,10cyclictest15417-21cstates07:37:470
3250996737,10cyclictest15417-21cstates07:37:470
325099673,47cyclictest10415-21/usr/sbin/munin07:23:060
325099673,36cyclictest15-21ksoftirqd/008:03:130
328399663,27cyclictest11459-21taskset11:43:043
328399663,27cyclictest11459-21taskset11:43:043
325099663,42cyclictest13448-21latency_hist07:32:300
325099663,37cyclictest1534-21/usr/sbin/munin08:32:540
325099663,32cyclictest25938-21cstates12:07:450
325099662,46cyclictest10330-21latency_hist07:22:310
325099662,43cyclictest18229-21ls09:13:050
15542669,34sleep30-21swapper/306:57:343
328399654,22cyclictest7300-21chrt08:48:053
328399653,23cyclictest13712-21chrt07:32:443
328399653,23cyclictest13712-21chrt07:32:443
328399653,21cyclictest6505-21chrt10:42:293
328399652,26cyclictest20345-21chrt09:17:433
328399652,23cyclictest5101-21chrt12:26:573
328399652,23cyclictest3513-21chrt08:37:523
328399652,21cyclictest5842-21chrt07:07:533
328399652,21cyclictest18469-21chrt10:07:563
328399652,21cyclictest1591-21taskset11:27:443
325099658,46cyclictest25649-21/usr/sbin/munin08:08:130
325099658,46cyclictest25649-21/usr/sbin/munin08:08:130
3250996548,10cyclictest29612-21kworker/u18:2+flush-179:010:52:380
3250996541,11cyclictest181rcu_preempt09:36:220
3250996541,11cyclictest181rcu_preempt09:36:220
328399644,21cyclictest13443-21chrt09:05:593
328399644,21cyclictest13443-21chrt09:05:593
328399643,24cyclictest13526-21taskset10:52:553
328399643,23cyclictest26731-21chrt11:14:433
328399643,22cyclictest17281-21taskset11:53:293
328399643,21cyclictest977-21chrt08:28:573
328399643,21cyclictest3577-21chrt07:02:593
328399642,23cyclictest11906-21chrt09:57:393
328399642,21cyclictest28060-21chrt11:17:433
3250996445,9cyclictest0-21swapper/008:13:070
325099644,42cyclictest7285-21sort07:12:450
325099643,44cyclictest5396-21wc08:43:000
328399639,13cyclictest0-21swapper/310:22:573
328399639,12cyclictest0-21swapper/308:03:463
328399638,12cyclictest0-21swapper/307:23:053
328399633,26cyclictest8856-21chrt10:45:543
328399633,26cyclictest8856-21chrt10:45:543
328399633,24cyclictest27775-21chrt12:10:273
328399633,23cyclictest13740-21chrt11:47:463
328399633,21cyclictest21515-21chrt11:59:423
328399633,21cyclictest18704-21chrt07:47:343
328399633,20cyclictest14803-21chrt09:07:543
328399632,26cyclictest20697-21taskset07:52:523
328399632,24cyclictest32647-21taskset09:37:503
328399632,24cyclictest25654-21taskset09:26:353
328399632,22cyclictest10297-21chrt09:53:543
328399632,22cyclictest10297-21chrt09:53:543
328399632,21cyclictest9175-21taskset07:17:533
325099634,28cyclictest22161-21fschecks_count07:57:500
328399629,13cyclictest0-21swapper/307:58:013
328399624,19cyclictest2096-21chrt08:32:583
328399623,20cyclictest14854-21chrt10:02:333
328399622,22cyclictest8215-21chrt07:13:073
328399622,22cyclictest5893-21taskset09:47:423
328399622,21cyclictest31926-21chrt09:37:173
328399622,21cyclictest31926-21chrt09:37:173
328399622,21cyclictest22711-21chrt10:14:583
328399622,21cyclictest22711-21chrt10:14:583
328399622,21cyclictest17795-21chrt11:00:003
328399622,20cyclictest31525-21taskset11:22:543
328399613,22cyclictest20450-21taskset11:04:013
328399613,21cyclictest18043-21chrt07:45:153
328399612,22cyclictest29470-21chrt12:12:593
328399612,21cyclictest24690-21chrt10:18:013
328399612,21cyclictest15811-21taskset07:37:583
328399612,21cyclictest15811-21taskset07:37:583
328399612,20cyclictest29939-21chrt08:18:243
328399603,21cyclictest9096-21chrt08:54:093
328399603,20cyclictest13125-21chrt07:29:193
328399602,21cyclictest7675-21chrt12:30:463
328399602,21cyclictest7675-21chrt12:30:463
328399602,20cyclictest24036-21chrt12:03:223
328399602,20cyclictest24036-21chrt12:03:223
328399594,19cyclictest28343-21chrt08:13:343
328399593,20cyclictest23483-21chrt11:09:083
328399593,20cyclictest23483-21chrt11:09:083
328399592,21cyclictest31774-21chrt08:26:263
328399592,21cyclictest31774-21chrt08:26:263
328399592,20cyclictest10630-21chrt08:58:143
328399582,20cyclictest5962-21chrt08:45:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional