You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 07:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Sep 06, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23167217014,112sleep223206-21fschecks_count19:05:152
23167217014,112sleep223206-21fschecks_count19:05:152
244849912157,45cyclictest13775-21latency_hist22:24:512
24466991182,25cyclictest32458-21/usr/sbin/munin21:10:160
24466991132,24cyclictest19462-21rm22:33:220
244669911154,47cyclictest0-21swapper/021:39:510
244669911154,47cyclictest0-21swapper/021:39:510
244669911052,51cyclictest0-21swapper/020:15:110
24466991103,6cyclictest0-21swapper/022:20:010
24466991103,24cyclictest28689-21ssh22:47:540
24466991103,24cyclictest28689-21ssh22:47:540
244669911011,89cyclictest0-21swapper/000:15:080
24484991093,28cyclictest27880-21seq19:17:552
24466991093,28cyclictest8566-21latency_hist21:24:510
24466991093,28cyclictest8566-21latency_hist21:24:510
24466991092,23cyclictest6513-21sh22:12:160
24484991083,49cyclictest5798-21taskset21:20:032
24484991083,49cyclictest5798-21taskset21:20:032
244669910851,50cyclictest0-21swapper/019:40:240
24466991083,29cyclictest19029-21/usr/sbin/munin20:30:210
244669910654,44cyclictest0-21swapper/021:55:070
24466991063,74cyclictest10026-21apt-get23:10:070
24466991063,74cyclictest10026-21apt-get23:10:070
24466991062,25cyclictest343-21runrttasks23:34:110
24466991053,29cyclictest8745-21ssh23:59:480
24466991053,23cyclictest23723-21ssh00:22:530
24466991053,21cyclictest25629-21ssh22:43:040
24466991052,23cyclictest10204-21ssh21:25:570
24466991044,87cyclictest16863-21apt-get20:25:030
24484991033,29cyclictest32692-21taskset19:32:322
24484991033,29cyclictest32692-21taskset19:32:322
24466991034,76cyclictest30247-21apt-get21:05:030
24466991033,6cyclictest0-21swapper/023:39:580
244669910333,60cyclictest0-21swapper/022:15:250
24466991032,30cyclictest359-21snmpd00:26:590
24466991032,30cyclictest359-21snmpd00:26:590
24466991032,24cyclictest18247-21ssh21:39:550
244669910268,22cyclictest28329-21latency_hist20:59:520
244669910247,48cyclictest27882-21/usr/sbin/munin00:30:150
244669910246,49cyclictest0-21swapper/023:05:120
244669910244,50cyclictest24939-21apt-key20:49:520
244669910244,50cyclictest24939-21apt-key20:49:520
244669910244,50cyclictest0-21swapper/000:05:240
24466991023,23cyclictest20446-21sh23:25:270
24484991019,68cyclictest18565-21apt-get00:15:082
24484991012,29cyclictest11027-21sh00:02:432
244669910148,45cyclictest0-21swapper/020:39:490
244669910148,45cyclictest0-21swapper/020:39:490
24466991012,24cyclictest27204-21ssh21:54:200
24466991003,7cyclictest0-21swapper/019:10:010
24466991003,22cyclictest4026-21ssh23:51:170
24466991002,26cyclictest3791-21ssh21:15:370
24484999976,13cyclictest0-21swapper/220:09:502
24484999976,13cyclictest0-21swapper/220:09:502
2448499993,50cyclictest7858-21ssh22:15:042
2446699993,7cyclictest0-21swapper/022:50:060
24466999928,48cyclictest181rcu_preempt22:55:260
2446699992,28cyclictest14457-21sh23:16:030
2446699992,22cyclictest478-21ssh00:37:430
2446699992,22cyclictest478-21ssh00:37:430
2446699984,8cyclictest0-21swapper/000:00:010
2446699983,22cyclictest4805-21ssh23:00:420
2446699983,22cyclictest14049-21sh21:32:490
2446699983,21cyclictest3468-21ssh22:07:280
2446699982,22cyclictest390-21ssh22:02:370
2446699982,22cyclictest390-21ssh22:02:370
2379629812,60sleep123890-21cat19:05:351
2379629812,60sleep123890-21cat19:05:351
24484999771,13cyclictest0-21swapper/220:34:522
24484999750,40cyclictest31591-21diskmemload23:35:002
2448499973,68cyclictest5954-21ssh23:55:042
2448499964,26cyclictest31591-21diskmemload23:42:322
2446699963,7cyclictest0-21swapper/000:10:020
24466999632,57cyclictest0-21swapper/023:45:000
24466999632,57cyclictest0-21swapper/023:45:000
2446699962,24cyclictest5245-21taskset19:49:280
24484999568,15cyclictest0-21swapper/221:48:022
2446699953,22cyclictest13140-21runrttasks20:12:190
24484999457,28cyclictest12395-21ssh21:30:162
2448499943,28cyclictest30475-21ntp_states19:25:202
2448499942,30cyclictest12365-21sh23:13:422
2448499942,30cyclictest12365-21sh23:13:422
2448499942,27cyclictest26064-21sh00:25:532
2448499942,27cyclictest26064-21sh00:25:532
24466999440,43cyclictest24396-21kworker/u19:3+events_unbound20:04:530
24466999440,43cyclictest24396-21kworker/u19:3+events_unbound20:04:530
2446699943,6cyclictest0-21swapper/020:00:020
2446699943,6cyclictest0-21swapper/020:00:020
2446699942,71cyclictest20535-21cstates22:35:080
2446699942,71cyclictest20535-21cstates22:35:080
2448499933,23cyclictest1358-21sort22:04:512
2448499933,23cyclictest1358-21sort22:04:512
2446699934,8cyclictest0-21swapper/019:55:040
2446699933,7cyclictest0-21swapper/021:00:000
24466999329,56cyclictest0-21swapper/019:25:090
230712938,61sleep023123-21expr19:05:090
230712938,61sleep023123-21expr19:05:090
2446699923,75cyclictest21705-21apt-get20:40:000
2446699923,26cyclictest25227-21apt-get20:50:440
2446699922,21cyclictest22598-21sh21:45:280
24484999172,11cyclictest0-21swapper/219:24:512
24484999170,11cyclictest0-21swapper/221:50:262
24484999149,36cyclictest15854-21ntp_offset00:10:182
2448499913,31cyclictest30247-21apt-get21:05:052
2446699914,6cyclictest0-21swapper/020:20:010
24484999073,11cyclictest9688-21cat23:09:512
24484999067,11cyclictest0-21swapper/219:54:522
2448499902,34cyclictest17228-21/usr/sbin/munin22:30:152
24480999049,22cyclictest24770-21ssh00:24:591
24480999049,22cyclictest24770-21ssh00:24:591
2446699902,32cyclictest29504-21seq19:22:490
24484998949,34cyclictest2732-21sh22:05:322
24484998943,40cyclictest526-21rs:main2
2448499893,8cyclictest0-21swapper/220:15:022
2448499893,29cyclictest25324-21cstates20:51:022
2448499892,28cyclictest343-21runrttasks21:56:582
24466998967,12cyclictest0-21swapper/019:50:260
2446699893,7cyclictest0-21swapper/019:35:040
2446699893,30cyclictest26238-21/usr/sbin/munin23:35:210
2446699893,28cyclictest14307-21/usr/sbin/munin22:25:090
2446699892,22cyclictest18123-21ssh23:22:280
2446699892,22cyclictest18123-21ssh23:22:280
2448499883,7cyclictest0-21swapper/221:15:042
24480998860,21cyclictest31524-21apt-key23:44:511
2432128816,47sleep30-21swapper/319:09:493
2432128816,47sleep30-21swapper/319:09:493
24484998769,9cyclictest0-21swapper/222:35:282
24484998769,9cyclictest0-21swapper/222:35:282
24484998764,15cyclictest343-21runrttasks23:24:522
2448499874,7cyclictest0-21swapper/219:10:012
2448499873,7cyclictest0-21swapper/220:00:022
2448499873,7cyclictest0-21swapper/220:00:022
2448499873,24cyclictest359-21snmpd19:44:522
2446699873,25cyclictest26564-21seq19:14:590
24484998663,12cyclictest0-21swapper/222:29:522
24484998642,38cyclictest16252-21sh21:35:272
24484998642,38cyclictest16252-21sh21:35:272
2448499862,8cyclictest0-21swapper/200:35:032
2448499862,8cyclictest0-21swapper/200:35:032
2446699862,25cyclictest31527-21/usr/sbin/munin19:30:260
2446699862,25cyclictest31527-21/usr/sbin/munin19:30:260
24484998567,9cyclictest0-21swapper/219:55:112
24484998566,9cyclictest0-21swapper/222:55:242
2448499854,7cyclictest0-21swapper/220:35:042
2448499854,7cyclictest0-21swapper/220:35:042
24484998539,40cyclictest21966-21fschecks_count00:20:112
24484998462,11cyclictest0-21swapper/220:44:512
2448499842,37cyclictest24212-21ps22:40:272
2448099843,71cyclictest31944-21apt-get23:45:091
2448099843,71cyclictest31944-21apt-get23:45:091
2448499833,35cyclictest12572-21rm00:05:142
2448499832,31cyclictest19153-21wc23:24:512
24484998263,12cyclictest0-21swapper/223:50:222
2448499824,40cyclictest31944-21apt-get23:45:012
2448499824,40cyclictest31944-21apt-get23:45:012
2448499823,8cyclictest0-21swapper/219:45:032
2448499823,33cyclictest30888-21/usr/sbin/munin22:50:312
2448499823,31cyclictest27694-21/usr/sbin/munin20:55:252
2448499822,35cyclictest17418-21/usr/sbin/munin20:25:222
2448499822,34cyclictest24239-21/usr/sbin/munin20:45:242
2448499822,34cyclictest24239-21/usr/sbin/munin20:45:242
2448499822,33cyclictest6287-21ssh23:04:342
24480998258,17cyclictest8718-40ogrotate23:59:481
24480998257,18cyclictest31591-21diskmemload00:24:501
24480998249,12cyclictest181rcu_preempt20:25:021
24480998241,14cyclictest181rcu_preempt19:35:121
24484998161,10cyclictest0-21swapper/223:29:482
24484998158,19cyclictest24457-21cyclictest22:14:082
2448499812,37cyclictest12794-21latency_hist23:14:552
2448499812,33cyclictest1273-21/usr/sbin/munin19:35:222
24480998163,11cyclictest17828-21ssh23:21:411
24480998163,11cyclictest17828-21ssh23:21:411
2448499804,35cyclictest9772-21timerandwakeup21:25:252
2448499803,33cyclictest22554-21cstates23:30:052
2448499803,32cyclictest1329-21ssh21:12:202
2448499802,32cyclictest18583-21fschecks_time21:40:122
2448099802,47cyclictest24664-21apt-get20:50:041
2448499792,35cyclictest15593-21/usr/sbin/munin20:20:132
2448499792,33cyclictest28574-21fschecks_count21:00:102
24480997945,14cyclictest20863-21latency22:35:171
24480997945,14cyclictest20863-21latency22:35:171
2448099792,35cyclictest3670-21modprobe19:44:481
2448499783,31cyclictest26993-21idleruntime22:45:152
2448499783,31cyclictest26993-21idleruntime22:45:152
2448499782,30cyclictest12587-21grep20:10:212
24480997857,14cyclictest8615-21sh21:24:511
24480997857,14cyclictest8615-21sh21:24:511
24480997848,24cyclictest24457-21cyclictest22:15:181
24480997750,20cyclictest14374-21fschecks_time22:25:101
2448099774,61cyclictest29453-21ssh22:49:481
2448099774,61cyclictest29453-21ssh22:49:481
24480997746,12cyclictest181rcu_preempt00:10:191
24480997744,13cyclictest181rcu_preempt21:50:221
2448099773,61cyclictest10026-21apt-get23:10:031
2448099773,61cyclictest10026-21apt-get23:10:031
24480997736,13cyclictest181rcu_preempt00:09:501
24480997638,14cyclictest15980-21latency_hist23:19:501
2448099762,43cyclictest30099-21date21:04:521
24488997517,32cyclictest0-21swapper/323:10:063
24488997517,32cyclictest0-21swapper/323:10:063
24480997438,8cyclictest0-21swapper/123:05:121
24480997438,13cyclictest181rcu_preempt20:05:281
24480997438,13cyclictest181rcu_preempt20:05:281
24480997426,14cyclictest28149-21grep19:19:511
2448099742,23cyclictest18836-21cpu00:15:391
24480997351,13cyclictest0-21swapper/119:55:171
2448099734,46cyclictest1550-21/usr/sbin/munin22:05:111
2448099734,42cyclictest18823-21kernelversion20:30:141
24480997332,15cyclictest181rcu_preempt21:42:081
24480997331,30cyclictest2572-21/usr/sbin/munin23:50:051
2448899723,35cyclictest31549-21chrt19:30:013
2448899723,35cyclictest31549-21chrt19:30:013
18452720,4sleep10-21swapper/121:13:401
24480997149,12cyclictest0-21swapper/119:10:111
24480997145,17cyclictest31591-21diskmemload21:35:161
24480997145,17cyclictest31591-21diskmemload21:35:161
24480997144,9cyclictest181rcu_preempt23:25:011
24480997143,20cyclictest22959-21netstat23:30:151
24480997142,12cyclictest181rcu_preempt23:01:571
2448099713,52cyclictest17654-21ssh22:30:161
24480997130,12cyclictest181rcu_preempt21:59:361
24480997125,12cyclictest181rcu_preempt21:47:481
2448099712,45cyclictest31-21ksoftirqd/120:20:241
2448899703,35cyclictest32349-21chrt21:10:143
2448899703,34cyclictest18812-21chrt00:15:383
2448099705,43cyclictest11846-21awk00:04:471
2448099704,41cyclictest343-21runrttasks20:00:591
2448099704,41cyclictest343-21runrttasks20:00:591
2448099704,34cyclictest31175-21fschecks_time22:00:121
2448099704,34cyclictest31175-21fschecks_time22:00:121
2448099703,27cyclictest576-21cstates22:55:061
24480997019,29cyclictest27699-21unixbench_singl20:55:251
2448899693,54cyclictest5916-21chrt23:54:593
2448899693,52cyclictest15874-21chrt00:10:193
24480996951,10cyclictest0-21swapper/121:25:121
2448099694,43cyclictest31868-21if_eth019:30:121
2448099694,43cyclictest31868-21if_eth019:30:121
2448099693,44cyclictest28953-21grep19:20:231
2448099693,31cyclictest2606-21awk21:14:591
24480996932,13cyclictest181rcu_preempt21:06:181
2448899683,32cyclictest32550-21chrt22:54:473
2448899683,32cyclictest21727-21taskset00:20:043
2448899682,33cyclictest15088-21chrt23:17:423
2448099684,44cyclictest27882-21/usr/sbin/munin00:30:211
24480996840,8cyclictest181rcu_preempt22:14:151
24480996839,10cyclictest31231-21fschecks_count00:35:131
24480996839,10cyclictest31231-21fschecks_count00:35:131
24480996836,9cyclictest20352-21fschecks_time20:35:121
24480996836,9cyclictest20352-21fschecks_time20:35:121
2448099683,49cyclictest30829-21grep22:50:311
2448899674,30cyclictest22410-21taskset23:29:583
2448899673,53cyclictest17891-21chrt23:21:513
2448899673,53cyclictest17891-21chrt23:21:513
2448899672,34cyclictest24293-21chrt20:45:253
2448899672,34cyclictest24293-21chrt20:45:253
2448899672,33cyclictest28301-21taskset22:46:533
2448899672,33cyclictest28301-21taskset22:46:533
24480996741,17cyclictest0-21swapper/119:47:031
2448099673,45cyclictest31279-21ls19:29:491
2448899664,49cyclictest5312-21chrt19:49:493
2448899663,32cyclictest8320-21chrt19:57:433
2448899663,32cyclictest29808-21taskset21:57:573
2448899663,28cyclictest29947-21chrt21:04:513
2448899662,34cyclictest10891-21chrt00:02:213
2448899662,33cyclictest14893-21chrt00:09:463
24480996645,12cyclictest0-21swapper/120:44:481
24480996626,13cyclictest181rcu_preempt23:35:101
2448899654,30cyclictest21316-21chrt20:38:453
2448899654,30cyclictest21316-21chrt20:38:453
2448899653,32cyclictest25111-21chrt22:41:423
2448899653,31cyclictest3632-21taskset19:44:223
2448899653,31cyclictest3263-21chrt23:50:213
2448899653,31cyclictest29190-21chrt23:40:153
2448899653,30cyclictest15917-21chrt21:35:233
2448899653,30cyclictest15917-21chrt21:35:233
2448899653,29cyclictest11713-21chrt22:20:223
2448899653,25cyclictest21713-21chrt20:40:033
2448899653,21cyclictest28486-21chrt23:39:513
2448899652,30cyclictest7777-21chrt22:14:553
24480996549,9cyclictest0-21swapper/121:34:511
24480996535,9cyclictest181rcu_preempt22:43:401
2448099652,38cyclictest12187-21fschecks_count20:10:111
2448899643,33cyclictest14636-21taskset21:34:223
2448899643,31cyclictest19904-21taskset21:41:353
2448899643,30cyclictest4406-21chrt21:17:113
2448899643,30cyclictest31222-21taskset19:29:163
2448899643,22cyclictest21475-21chrt21:45:003
2448899642,32cyclictest27366-21taskset21:54:443
2448899642,31cyclictest21780-21taskset22:36:153
2448899642,31cyclictest21780-21taskset22:36:153
2448899642,31cyclictest13137-21chrt20:12:173
2448899642,27cyclictest1598-21chrt22:05:023
24480996445,14cyclictest11022-21sh22:20:061
24480996428,11cyclictest181rcu_preempt20:49:511
24480996428,11cyclictest181rcu_preempt20:49:511
2448899633,27cyclictest5562-21taskset19:50:053
2448899633,23cyclictest4683-21chrt23:00:273
2448899632,48cyclictest31178-21chrt21:06:253
2448899632,32cyclictest17777-21taskset22:30:193
2448899632,31cyclictest1590-21taskset22:55:333
2448899632,29cyclictest27861-21chrt20:56:543
2448899632,29cyclictest15680-21taskset20:20:143
2448899632,28cyclictest29707-21taskset19:24:503
2448899632,26cyclictest16844-21chrt20:25:003
2448099632,46cyclictest5785-21fschecks_time19:50:121
2448099632,46cyclictest13811-21fschecks_count20:15:111
2448899623,28cyclictest26468-21taskset20:54:393
2448899623,25cyclictest31722-21chrt00:35:243
2448899623,25cyclictest31722-21chrt00:35:243
2448899622,31cyclictest6195-21taskset21:20:153
2448899622,31cyclictest6195-21taskset21:20:153
2448899622,30cyclictest19456-21chrt20:30:273
2448899622,30cyclictest1838-21chrt19:37:183
2448899622,27cyclictest32518-21chrt22:01:463
2448899622,27cyclictest32518-21chrt22:01:463
2448899622,27cyclictest29118-21chrt00:30:463
2448899622,25cyclictest5237-21chrt22:10:173
2448899614,8cyclictest0-21swapper/319:10:013
2448899613,28cyclictest27809-21taskset19:17:013
2448899613,22cyclictest19670-21chrt23:25:123
2448899612,30cyclictest8657-21taskset23:07:403
2448899612,26cyclictest11931-21taskset21:29:523
2448899603,27cyclictest14842-21chrt20:18:243
2448899603,22cyclictest16968-21chrt22:29:513
2448899602,27cyclictest1953-21chrt23:48:593
2448899602,27cyclictest1953-21chrt23:48:593
2448899593,24cyclictest11514-21chrt20:07:023
2448899593,24cyclictest11514-21chrt20:07:023
2448899593,21cyclictest26219-21chrt00:26:163
2448899593,21cyclictest26219-21chrt00:26:163
2448899583,25cyclictest9892-21taskset20:01:523
2448899583,25cyclictest9892-21taskset20:01:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional