You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-07 - 05:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6.osadl.org (updated Mon Jul 07, 2025 00:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28009911912,94cyclictest0-21swapper/100:25:151
28009911482,19cyclictest26-21ksoftirqd/122:45:141
28009910730,63cyclictest0-21swapper/121:30:141
28009910729,63cyclictest0-21swapper/121:05:161
28009910463,28cyclictest26-21ksoftirqd/120:30:141
28009910359,30cyclictest26-21ksoftirqd/123:20:161
27979910212,30cyclictest0-21swapper/022:50:130
28009910160,30cyclictest26-21ksoftirqd/123:40:151
28009910159,30cyclictest26-21ksoftirqd/123:35:131
27979910010,28cyclictest0-21swapper/021:15:150
2800999952,33cyclictest26-21ksoftirqd/121:25:161
2800999943,41cyclictest14065-21diskmemload21:10:181
2797999912,28cyclictest0-21swapper/000:10:130
2797999912,27cyclictest0-21swapper/020:05:220
249629915,38sleep00-21swapper/019:08:560
2800999856,30cyclictest26-21ksoftirqd/122:15:151
2797999813,29cyclictest0-21swapper/021:10:160
2797999813,27cyclictest0-21swapper/020:20:230
2800999751,34cyclictest26-21ksoftirqd/100:10:141
2800999650,33cyclictest26-21ksoftirqd/121:15:171
264529629,55sleep10-21swapper/119:10:001
2800999553,30cyclictest26-21ksoftirqd/122:55:141
2800999547,33cyclictest26-21ksoftirqd/122:40:131
2800999511,68cyclictest0-21swapper/100:30:141
2800999511,68cyclictest0-21swapper/100:30:141
279799958,34cyclictest36-21kcompactd020:45:170
2800999412,66cyclictest0-21swapper/119:55:151
2800999410,65cyclictest0-21swapper/122:10:111
2800999313,63cyclictest0-21swapper/122:25:151
279799937,28cyclictest32048-21apt-get22:00:160
280099929,64cyclictest31184-21runrttasks23:30:151
2800999238,39cyclictest26-21ksoftirqd/120:25:251
279799929,34cyclictest36-21kcompactd021:50:170
2800999111,63cyclictest0-21swapper/100:35:161
2800999111,61cyclictest0-21swapper/123:45:121
2800999042,33cyclictest26-21ksoftirqd/119:15:161
2800999012,57cyclictest0-21swapper/120:40:181
2800999012,56cyclictest0-21swapper/120:00:141
2800999011,60cyclictest0-21swapper/123:25:141
2800998913,58cyclictest0-21swapper/121:35:151
2800998911,62cyclictest0-21swapper/120:55:251
2800998911,58cyclictest0-21swapper/119:45:151
2800998911,56cyclictest0-21swapper/123:00:181
2800998811,62cyclictest0-21swapper/121:50:141
2800998811,56cyclictest0-21swapper/123:10:131
2800998732,36cyclictest26-21ksoftirqd/119:35:141
2800998711,58cyclictest0-21swapper/122:35:131
2800998510,57cyclictest0-21swapper/123:50:171
2800998510,57cyclictest0-21swapper/123:50:171
2800998510,55cyclictest0-21swapper/121:55:141
280099845,58cyclictest0-21swapper/120:45:201
2800998432,33cyclictest26-21ksoftirqd/120:10:151
280099835,57cyclictest0-21swapper/100:00:151
2800998336,33cyclictest0-21swapper/120:50:131
2800998331,34cyclictest0-21swapper/119:40:151
2800998311,53cyclictest0-21swapper/100:20:161
2800998235,33cyclictest0-21swapper/120:05:201
2800998230,31cyclictest26-21ksoftirqd/100:15:141
2800998211,51cyclictest0-21swapper/121:20:191
2800998134,31cyclictest0-21swapper/122:20:151
2800997931,33cyclictest0-21swapper/121:00:161
2800997930,30cyclictest0-21swapper/122:05:131
2800997929,33cyclictest0-21swapper/119:20:131
2800997929,33cyclictest0-21swapper/119:20:131
2800997830,27cyclictest0-21swapper/100:05:161
280099777,45cyclictest26-21ksoftirqd/119:10:151
2800997731,28cyclictest0-21swapper/123:05:181
2800997730,31cyclictest0-21swapper/123:55:171
2800997725,30cyclictest0-21swapper/120:15:121
2800997626,29cyclictest0-21swapper/121:45:141
2800997610,44cyclictest28211-21apt-get20:20:161
2797997610,43cyclictest30247-21apt-get20:25:150
2800997527,29cyclictest26-21ksoftirqd/121:40:161
2800997525,31cyclictest0-21swapper/119:50:141
2800997525,28cyclictest0-21swapper/120:35:141
2800997427,29cyclictest0-21swapper/122:50:151
2800997327,28cyclictest0-21swapper/119:30:151
2800997326,28cyclictest0-21swapper/122:00:271
2800997222,28cyclictest0-21swapper/122:30:141
2800996920,30cyclictest0-21swapper/119:25:131
279799688,50cyclictest15645-21apt-get19:45:140
2797996834,28cyclictest14-21ksoftirqd/023:00:020
2800996721,27cyclictest0-21swapper/123:15:141
279799677,52cyclictest20130-21apt-get00:30:170
279799677,52cyclictest20130-21apt-get00:30:170
279799668,50cyclictest22413-21apt-get23:05:180
2797996413,31cyclictest0-21swapper/020:10:130
2797996412,31cyclictest0-21swapper/020:35:160
2797996336,11cyclictest0-21swapper/022:14:590
2797996323,34cyclictest7010-21aten2.4-expect19:20:180
2797996323,34cyclictest7010-21aten2.4-expect19:20:180
2797996319,19cyclictest261-21systemd-journal21:32:360
2797996318,19cyclictest261-21systemd-journal22:37:470
279799627,18cyclictest20881-21apt-get20:00:130
2797996237,19cyclictest14-21ksoftirqd/021:55:180
2797996136,19cyclictest14-21ksoftirqd/021:27:310
2797996134,19cyclictest764-21cstates23:35:170
2797996131,22cyclictest14-21ksoftirqd/023:15:230
2797996035,19cyclictest14-21ksoftirqd/019:30:170
279799603,19cyclictest9440-40runlevel00:00:010
2797996030,22cyclictest14-21ksoftirqd/023:00:210
279799598,44cyclictest0-21swapper/021:00:230
2797995940,11cyclictest14-21ksoftirqd/022:15:360
2797995934,19cyclictest14-21ksoftirqd/023:10:160
2797995923,13cyclictest261-21systemd-journal19:37:140
2797995922,31cyclictest8686-21aten2.4-expect19:25:170
2797995920,32cyclictest14-21ksoftirqd/000:25:280
279799586,17cyclictest13914-21apt-get19:40:170
2797995839,10cyclictest14-21ksoftirqd/020:45:010
2797995835,18cyclictest14-21ksoftirqd/019:15:180
279799583,48cyclictest13754-21aten2.4-expect22:40:190
2797995833,9cyclictest14-21ksoftirqd/000:35:210
2797995741,11cyclictest0-21swapper/022:08:200
2797995740,10cyclictest14-21ksoftirqd/022:30:000
2797995739,12cyclictest8470-21apt-get20:55:140
279799573,46cyclictest19738-21cut19:55:290
2797995732,20cyclictest14-21ksoftirqd/000:20:190
2797995730,21cyclictest14-21ksoftirqd/019:10:290
2797995721,30cyclictest12571-21aten2.4-expect21:05:180
2797995715,18cyclictest261-21systemd-journal21:22:340
2797995714,36cyclictest17417-21aten2.4-expect19:50:160
2797995714,18cyclictest261-21systemd-journal20:52:290
2797995640,9cyclictest14-21ksoftirqd/020:30:110
2797995633,18cyclictest14-21ksoftirqd/022:45:160
2797995631,19cyclictest14-21ksoftirqd/021:40:220
2797995631,19cyclictest14-21ksoftirqd/000:00:180
279799562,7cyclictest151rcu_preempt00:15:230
2797995617,12cyclictest6130-21aten2.4-expect23:50:200
2797995617,12cyclictest6130-21aten2.4-expect23:50:200
279799555,44cyclictest0-21swapper/020:15:190
2797995536,11cyclictest14-21ksoftirqd/000:05:370
2797995519,30cyclictest27830-21aten2.4-expect23:20:220
2797995517,32cyclictest26635-21aten2.4-expect21:45:170
279799543,43cyclictest11170-21grep22:30:380
279799535,43cyclictest0-21swapper/021:35:170
2797995337,10cyclictest14-21ksoftirqd/023:45:300
279799526,11cyclictest0-21swapper/023:30:260
2797995237,9cyclictest14-21ksoftirqd/023:25:300
2797995236,10cyclictest14-21ksoftirqd/023:40:140
279799509,28cyclictest14-21ksoftirqd/022:20:290
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional