You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 08:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Mon Jul 20, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24086212811,80sleep124120-21munin-run18:56:401
24086212811,80sleep124120-21munin-run18:56:401
24225991213,22cyclictest1160-21interrupts22:47:050
24225991193,43cyclictest32687-21ssh21:51:570
24225991152,34cyclictest11998-21taskset22:11:350
23468211518,61sleep223531-21find18:52:252
23468211518,61sleep223531-21find18:52:252
24225991122,27cyclictest26097-21sh21:40:570
24225991112,23cyclictest26784-21ssh22:36:170
242259911119,67cyclictest21372-21rm00:16:250
242259911119,67cyclictest21372-21rm00:16:250
24225991103,28cyclictest30802-21ssh21:47:230
242259911017,61cyclictest0-21swapper/022:26:550
24225991092,29cyclictest16794-21taskset20:11:220
24225991092,24cyclictest5880-21taskset23:49:150
24225991092,24cyclictest5880-21taskset23:49:150
24225991092,22cyclictest16272-21ssh21:23:570
24225991092,22cyclictest16272-21ssh21:23:570
242259910843,59cyclictest0-21swapper/023:31:410
24225991082,28cyclictest8088-21diskmemload21:11:330
24225991082,28cyclictest8088-21diskmemload21:11:330
24225991073,27cyclictest13736-21sh21:20:090
24225991072,23cyclictest8203-21runrttasks19:43:080
24225991072,23cyclictest5003-21sh21:06:200
24225991063,21cyclictest5390-21ssh22:53:490
24225991062,25cyclictest426-21sh23:40:460
242259910548,50cyclictest170-21jbd2/mmcblk2p2-819:32:120
242259910513,22cyclictest14390-21sh22:14:560
242259910445,52cyclictest29906-21fschecks_count19:12:020
24225991042,27cyclictest23164-21ssh23:23:330
24225991042,26cyclictest8966-21taskset22:06:300
24225991033,28cyclictest25383-21/usr/sbin/munin20:36:500
24225991032,24cyclictest3842-21ssh21:57:530
24225991032,23cyclictest31550-21ssh22:42:560
24225991032,23cyclictest31550-21ssh22:42:560
24225991023,33cyclictest5678-21cstates19:37:210
24225991023,30cyclictest352-21runrttasks00:19:400
24225991023,24cyclictest31454-21df19:16:590
24225991022,22cyclictest29029-21ssh21:45:510
24225991022,22cyclictest29029-21ssh21:45:510
24225991022,22cyclictest12099-21ssh23:59:590
24225991014,22cyclictest16646-21ssh22:17:540
24225991012,24cyclictest17251-21taskset00:08:000
24225991012,23cyclictest11788-21ssh23:05:050
24225991012,22cyclictest8412-21ssh22:58:590
24225991012,22cyclictest8412-21ssh22:58:590
24225991012,22cyclictest26965-21ssh00:25:310
24225991012,22cyclictest26965-21ssh00:25:310
24231991003,81cyclictest5042-21apt-get19:36:542
24225991003,24cyclictest20972-21ssh23:20:460
24225991002,23cyclictest28900-21ssh22:38:520
24225999935,56cyclictest0-21swapper/019:52:300
2422599993,29cyclictest13328-21taskset19:58:300
2422599993,25cyclictest27829-21sort23:32:020
2422599992,22cyclictest2544-21ssh23:43:200
2422999983,43cyclictest31615-21diskmemload23:41:531
24229999812,36cyclictest25654-21grep23:27:181
24225999846,44cyclictest0-21swapper/020:56:410
2422599982,22cyclictest20391-21taskset22:25:060
2422599982,21cyclictest14518-21sh23:09:190
24225999741,49cyclictest9448-21timerwakeupswit21:12:160
24225999739,52cyclictest2847-21threads19:27:160
2422599973,24cyclictest22692-21sh21:34:440
2422599972,22cyclictest8839-21ssh23:54:120
2422599972,22cyclictest15042-21taskset20:04:450
2422599962,25cyclictest27739-21taskset19:06:010
2422599962,22cyclictest16436-21awk23:12:150
2422599962,22cyclictest16436-21awk23:12:150
24229999540,50cyclictest24216-21cyclictest21:37:031
2422999952,37cyclictest24273-21apt-get22:31:531
24225999565,22cyclictest9741-21unixbench_singl19:47:160
2422599952,25cyclictest706-21fschecks_time19:22:030
24229999439,47cyclictest0-21swapper/121:56:431
24229999434,12cyclictest0-21swapper/122:46:431
24229999434,12cyclictest0-21swapper/122:46:431
2422999943,37cyclictest32212-21grep19:17:181
2422999943,30cyclictest25179-21apt-config20:36:431
2422999943,30cyclictest25179-21apt-config20:36:431
24225999470,15cyclictest29637-21awk20:47:210
2422599944,31cyclictest26994-21/usr/sbin/munin20:42:180
2422599943,30cyclictest19326-21sendmail_mailqu20:17:130
2422599943,30cyclictest19326-21sendmail_mailqu20:17:130
2422599943,27cyclictest18173-21uniq21:27:290
2422599942,20cyclictest13285-21ssh00:01:570
2422599942,20cyclictest13285-21ssh00:01:570
24229999334,9cyclictest0-21swapper/119:57:161
2422599934,23cyclictest23323-21unin-run20:31:400
24231999227,31cyclictest39-21ksoftirqd/223:01:362
24231999227,31cyclictest39-21ksoftirqd/223:01:362
24229999239,45cyclictest0-21swapper/100:01:301
2422999923,35cyclictest14567-21switchtime20:02:141
2422999922,37cyclictest18831-21apt-get00:11:491
2422999922,37cyclictest18831-21apt-get00:11:491
2422599923,30cyclictest21662-21systemctl20:26:390
2422599923,23cyclictest25726-21runrttasks19:01:260
2422599923,23cyclictest25726-21runrttasks19:01:260
2422599922,32cyclictest31941-21ssh20:56:530
2422999914,33cyclictest18659-21ssh00:11:421
24229999140,46cyclictest24216-21cyclictest22:11:431
2422999913,43cyclictest9951-21fschecks_time23:02:011
24229999133,8cyclictest0-21swapper/123:36:411
2422999913,36cyclictest657-21fschecks_count19:22:031
2422999913,34cyclictest3897-21sort19:31:591
24229999131,9cyclictest0-21swapper/121:18:421
24229999131,12cyclictest0-21swapper/120:17:021
24229999131,12cyclictest0-21swapper/120:17:021
2422999912,41cyclictest28173-21timerwakeupswit22:37:161
24231999050,29cyclictest16831-21sh20:11:402
2422999903,34cyclictest15193-21latency_hist22:16:431
2422999903,33cyclictest12687-21/usr/sbin/munin23:07:041
2422599903,31cyclictest17351-21fschecks_time20:12:010
2423899893,41cyclictest0-21swapper/321:56:593
2422999895,37cyclictest5405-21latency_hist21:06:431
24229998943,41cyclictest24216-21cyclictest21:31:551
24229998938,43cyclictest0-21swapper/122:47:041
2422999893,37cyclictest352-21runrttasks23:52:131
2422999893,35cyclictest28533-21runrttasks21:44:271
2422999893,35cyclictest28533-21runrttasks21:44:271
2422999893,35cyclictest19443-21grep23:17:151
2422999893,33cyclictest21795-21ssh23:21:581
2422999892,34cyclictest5910-21/usr/sbin/munin19:37:281
2422999892,33cyclictest15537-21timerwakeupswit21:22:181
2422999892,33cyclictest15537-21timerwakeupswit21:22:181
2422999892,31cyclictest27384-21run-parts00:26:391
2422999892,31cyclictest27384-21run-parts00:26:391
2422599893,30cyclictest28570-21awk19:07:080
24231998861,9cyclictest16745-21head23:12:182
24231998861,9cyclictest16745-21head23:12:182
2422999885,30cyclictest20415-21latency_hist21:31:431
2422999883,39cyclictest5877-21chrt22:01:131
2422999883,38cyclictest28856-21timerandwakeup19:07:161
2422999883,34cyclictest15664-21latency_hist00:06:411
2422999883,34cyclictest15664-21latency_hist00:06:411
2422999883,33cyclictest7268-21/usr/sbin/munin22:57:081
2422999883,33cyclictest7268-21/usr/sbin/munin22:57:081
2422999883,33cyclictest6156-21ps21:07:151
2422999883,33cyclictest6156-21ps21:07:151
2422999883,29cyclictest3017-21unixbench_multi19:27:171
2422999883,27cyclictest18526-21fschecks_count22:22:011
2422999882,35cyclictest15960-21fschecks_time23:12:031
2422999882,35cyclictest15960-21fschecks_time23:12:031
24229998810,33cyclictest10710-21sort19:52:021
2422599882,26cyclictest352-21runrttasks20:32:260
2422599882,26cyclictest352-21runrttasks20:32:260
2422599882,24cyclictest24228-21sed18:56:440
2422599882,24cyclictest24228-21sed18:56:440
2422999873,35cyclictest25129-21switchtime18:57:141
2422999873,35cyclictest25129-21switchtime18:57:141
2422999873,34cyclictest9698-21tail19:47:151
2422999873,33cyclictest6596-21ssh22:56:421
2422999872,35cyclictest5037-21timerwakeupswit23:47:181
2422999872,35cyclictest5037-21timerwakeupswit23:47:181
2423199867,56cyclictest17242-21apt-get21:26:552
2423199863,75cyclictest58-21kcompactd019:51:552
2422999863,36cyclictest21797-21latency_hist20:26:421
2422999863,35cyclictest26376-21grep19:01:511
2422999863,34cyclictest31201-21grep20:52:171
2422999863,31cyclictest15813-21latency22:17:071
2422999862,35cyclictest891-21latency_hist23:41:421
2422999862,35cyclictest32155-21fschecks_count20:57:021
24231998559,10cyclictest181rcu_preempt23:18:162
2422999854,31cyclictest16001-21ntp_kernel_pll_20:07:081
24229998538,9cyclictest24413-21kworker/u18:100:21:391
2422999853,33cyclictest30656-21unixbench_singl19:12:171
2422999852,36cyclictest25712-21fschecks_count20:38:211
24231998449,19cyclictest4073-21ssh21:03:432
24231998420,32cyclictest39-21ksoftirqd/222:07:062
2422999845,35cyclictest352-21runrttasks20:27:001
2422999843,35cyclictest32338-21idleruntime-cro21:51:391
2422999842,32cyclictest8511-21modprobe19:46:401
24231998357,17cyclictest19676-21snmpd20:06:422
24231998311,23cyclictest4173-21sh23:46:582
24231998311,23cyclictest4173-21sh23:46:582
2422999834,33cyclictest21591-21tune2fs22:27:021
2422999833,37cyclictest8693-21fschecks_count21:12:011
24229998329,10cyclictest0-21swapper/122:02:181
24231998252,13cyclictest181rcu_preempt22:05:572
24231998245,13cyclictest181rcu_preempt20:16:432
24231998234,17cyclictest181rcu_preempt00:18:052
24231998137,16cyclictest181rcu_preempt21:18:162
2422999814,31cyclictest27218-21fschecks_count20:42:021
24231998051,12cyclictest181rcu_preempt21:25:182
24231998051,12cyclictest181rcu_preempt21:25:182
24231998034,17cyclictest181rcu_preempt22:12:392
2423199802,44cyclictest13684-21cstates00:03:452
2423199802,44cyclictest13684-21cstates00:03:452
2423199795,49cyclictest13581-21modprobe20:01:392
24231997942,8cyclictest181rcu_preempt21:37:082
2422999794,36cyclictest352-21runrttasks20:48:001
24231997847,12cyclictest181rcu_preempt23:36:402
24231997824,29cyclictest39-21ksoftirqd/223:01:562
24231997811,40cyclictest39-21ksoftirqd/219:32:032
2422999783,29cyclictest352-21runrttasks20:15:191
24231997745,9cyclictest181rcu_preempt19:48:142
24231997740,16cyclictest181rcu_preempt20:44:242
24231997734,11cyclictest181rcu_preempt22:56:272
24231997728,17cyclictest181rcu_preempt22:19:352
2423199772,65cyclictest28872-21grep20:47:052
24231997654,8cyclictest181rcu_preempt23:24:042
24231997649,9cyclictest181rcu_preempt20:57:042
24231997641,12cyclictest181rcu_preempt00:14:382
24231997641,12cyclictest181rcu_preempt00:14:382
24231997640,11cyclictest181rcu_preempt21:12:032
2423199761,29cyclictest39-21ksoftirqd/223:26:512
24231997553,8cyclictest181rcu_preempt22:46:242
24231997553,8cyclictest181rcu_preempt22:46:242
24231997543,13cyclictest181rcu_preempt21:35:502
2423199752,29cyclictest39-21ksoftirqd/221:54:432
24231997445,13cyclictest181rcu_preempt19:30:572
24231997443,12cyclictest181rcu_preempt18:59:342
24231997443,12cyclictest181rcu_preempt18:59:342
24231997421,24cyclictest0-21swapper/223:42:062
24231997353,14cyclictest26975-21ssh22:36:412
24231997349,8cyclictest181rcu_preempt20:27:032
24231997348,9cyclictest181rcu_preempt23:37:032
24231997346,9cyclictest181rcu_preempt21:44:332
24231997346,9cyclictest181rcu_preempt21:44:332
24231997337,12cyclictest181rcu_preempt22:37:012
24231997318,19cyclictest39-21ksoftirqd/200:09:202
24231997246,8cyclictest181rcu_preempt22:24:042
24231997237,13cyclictest181rcu_preempt21:51:422
2423199722,38cyclictest39-21ksoftirqd/219:42:152
24231997213,24cyclictest39-21ksoftirqd/219:26:342
24231997212,24cyclictest39-21ksoftirqd/219:18:522
24231997150,8cyclictest181rcu_preempt23:54:452
24231997148,8cyclictest181rcu_preempt22:47:322
24231997147,10cyclictest181rcu_preempt23:09:362
24231997143,9cyclictest181rcu_preempt19:04:282
24231997136,13cyclictest181rcu_preempt20:38:342
2423199713,49cyclictest25087-21apt-key20:36:422
2423199713,49cyclictest25087-21apt-key20:36:422
2423199713,46cyclictest4154-21ssh21:58:102
2423199712,48cyclictest39-21ksoftirqd/220:16:572
2423199712,48cyclictest39-21ksoftirqd/220:16:572
2423899703,33cyclictest9401-21chrt22:06:553
24231997036,13cyclictest181rcu_preempt23:59:052
2423199703,35cyclictest39-21ksoftirqd/200:22:142
2423199703,35cyclictest39-21ksoftirqd/200:22:142
2423199702,24cyclictest39-21ksoftirqd/221:10:172
2423199702,24cyclictest39-21ksoftirqd/221:10:172
2423899692,35cyclictest23432-21chrt22:30:143
2423899692,35cyclictest18746-21chrt00:11:423
2423199693,43cyclictest28239-21df19:06:592
2423899683,34cyclictest12006-21taskset23:05:413
2423899682,35cyclictest27235-21taskset00:26:183
2423899682,35cyclictest27235-21taskset00:26:183
24231996846,15cyclictest0-21swapper/220:54:092
24231996845,17cyclictest1-21systemd22:31:302
2423199682,45cyclictest20518-21fschecks_count20:22:022
2423899673,32cyclictest26093-21chrt22:34:193
2423899672,34cyclictest25775-21chrt23:27:273
2423899672,33cyclictest1405-21taskset23:42:023
2423899663,32cyclictest22481-21chrt20:27:103
2423899662,35cyclictest27273-21chrt22:36:553
2423899662,34cyclictest7656-21taskset22:02:493
2423899662,33cyclictest22403-21taskset00:17:103
2423899662,32cyclictest23811-21taskset23:25:243
2423899662,31cyclictest9607-21taskset23:56:223
2423899662,30cyclictest32298-21taskset23:39:063
2423199664,40cyclictest352-21runrttasks19:12:472
24238996542,14cyclictest115472chrt19:52:313
2423899653,32cyclictest3085-21chrt19:27:193
2423899653,31cyclictest6699-21chrt21:07:373
2423899653,31cyclictest6699-21chrt21:07:373
2423899652,33cyclictest20921-21chrt21:32:003
2423899652,33cyclictest20116-21taskset00:12:483
2423899652,33cyclictest20116-21taskset00:12:483
2423899652,32cyclictest1478-21chrt19:22:413
2423899652,31cyclictest4324-21taskset22:52:363
2423899652,31cyclictest2669-21taskset22:49:323
2423899643,31cyclictest4006-21taskset19:32:013
2423899643,29cyclictest606-21chrt21:52:063
2423899643,28cyclictest16739-21taskset20:10:373
2423899642,33cyclictest15896-21taskset23:12:023
2423899642,33cyclictest15896-21taskset23:12:023
2423899642,32cyclictest31445-21chrt22:42:393
2423899642,32cyclictest31445-21chrt22:42:393
2423899642,31cyclictest12239-21taskset00:00:233
2423899633,34cyclictest3501-21chrt21:02:183
2423899633,30cyclictest9893-21chrt21:13:133
2423899633,30cyclictest30748-21chrt19:13:013
2423899633,30cyclictest24569-21chrt20:32:323
2423899633,30cyclictest24569-21chrt20:32:323
2423899633,29cyclictest29645-21chrt20:47:273
2423899633,29cyclictest14876-21taskset22:16:193
2423899632,30cyclictest31404-21chrt20:54:203
2423899632,28cyclictest28077-21chrt20:43:183
2423899626,42cyclictest0-21swapper/322:57:023
2423899626,42cyclictest0-21swapper/322:57:023
2423899623,30cyclictest13480-21chrt00:02:303
2423899623,30cyclictest13480-21chrt00:02:303
2423899623,29cyclictest9983-21chrt19:49:553
2423899623,28cyclictest6511-21chrt23:51:023
2423899623,28cyclictest6511-21chrt23:51:023
2423899623,28cyclictest14896-21chrt20:03:003
2423899623,26cyclictest29423-21chrt19:11:403
2423899622,29cyclictest25454-21chrt20:37:313
2423899622,27cyclictest31899-21chrt21:50:283
2423899622,27cyclictest24319-21taskset21:37:103
2423899613,34cyclictest19047-21taskset23:17:053
2423899613,31cyclictest20297-21taskset21:31:233
2423899613,29cyclictest19711-21chrt20:17:303
2423899613,29cyclictest19711-21chrt20:17:303
2423899613,28cyclictest21420-21chrt20:23:493
2423899613,27cyclictest6584-21chrt19:37:563
2423899613,27cyclictest29383-21chrt23:34:163
2423899613,27cyclictest13476-21chrt20:00:243
2423899613,26cyclictest15067-21chrt23:10:523
2423899612,28cyclictest18130-21taskset20:12:483
2423899603,45cyclictest14958-21taskset21:22:053
2423899603,45cyclictest14958-21taskset21:22:053
2423899603,31cyclictest28922-21taskset21:45:343
2423899603,31cyclictest28922-21taskset21:45:343
2423899603,29cyclictest8443-21taskset19:46:153
2423899603,23cyclictest24862-21chrt18:57:063
2423899603,23cyclictest24862-21chrt18:57:063
2423899602,20cyclictest13054-21chrt21:18:163
2423899593,30cyclictest854-21chrt20:58:043
2423899593,24cyclictest32304-21chrt19:17:233
2423899593,23cyclictest19752-21chrt22:23:173
2423899592,23cyclictest15524-21chrt22:17:003
2423899578,40cyclictest0-21swapper/319:06:403
24238995010,33cyclictest0-21swapper/318:56:453
24238995010,33cyclictest0-21swapper/318:56:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional