You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 04:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackcslot4.osadl.org (updated Fri Sep 19, 2025 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25276872321282,25sleep00-21swapper/019:09:420
25275772311276,20sleep10-21swapper/119:08:311
26336972620,4sleep00-21swapper/022:34:060
2527829995513,23cyclictest2592738-40apt-check21:35:160
125899540,4rtkit-daemon1257-21rtkit-daemon00:17:051
26479302530,4sleep02647926-21ssh22:55:150
125899530,4rtkit-daemon1257-21rtkit-daemon21:27:160
125899530,4rtkit-daemon1257-21rtkit-daemon21:10:180
125899520,4rtkit-daemon1257-21rtkit-daemon20:38:150
125899500,4rtkit-daemon1257-21rtkit-daemon20:55:050
125899500,3rtkit-daemon1257-21rtkit-daemon19:44:060
25455652490,2sleep1251rcuc/119:50:231
2527829994910,13cyclictest2675498-21ssh23:35:010
125899490,4rtkit-daemon1257-21rtkit-daemon23:17:510
252782999489,11cyclictest2603488-21apt-get21:50:150
125899470,4rtkit-daemon1257-21rtkit-daemon00:07:120
252782999468,10cyclictest2540235-21sed19:40:010
2527829994612,11cyclictest2654043-21ssh23:03:590
125899460,4rtkit-daemon1257-21rtkit-daemon21:42:460
2527829994511,22cyclictest2670408-21ssh23:25:540
2527829994511,11cyclictest2574417-21diskmemload22:03:160
2527829994413,10cyclictest2646882-21ssh22:53:210
2527829994412,12cyclictest2708476-21sh00:24:120
2527829994412,11cyclictest2574417-21diskmemload23:23:060
2527829994412,11cyclictest2574417-21diskmemload23:23:060
2527829994412,10cyclictest2574417-21diskmemload22:16:230
252782999436,21cyclictest2692551-21apt-get00:00:130
2527829994313,8cyclictest2613899-21apt-get22:05:170
2527829994313,10cyclictest2638234-21ssh22:40:190
2527829994312,14cyclictest2659753-21seq23:11:180
2527829994311,13cyclictest2643439-21ssh22:48:040
2527829994311,11cyclictest2574417-21diskmemload22:14:510
2527829994311,10cyclictest2655526-21taskset23:05:230
2527829994310,12cyclictest2702014-21apt-get00:15:140
252782999427,8cyclictest2603325-21cat21:50:010
252782999427,11cyclictest2588813-21apt-get21:30:160
252782999427,10cyclictest2683260-21ntpq23:45:230
2527829994212,11cyclictest2532684-21/usr/sbin/munin19:20:180
2527829994212,10cyclictest2629913-21ssh22:28:160
2527829994211,9cyclictest828-21runrttasks21:56:450
2527829994211,12cyclictest2626123-21seq22:22:090
252782999417,19cyclictest2709097-21apt-get00:25:170
252782999416,11cyclictest2560208-21cat20:30:010
2527829994111,13cyclictest2700847-21seq00:11:570
2527829994110,13cyclictest2636465-21seq22:37:220
125899410,5rtkit-daemon2592738-40apt-check21:35:191
252782999406,15cyclictest2553267-21pmu-power20:10:230
252782999406,11cyclictest2531569-21find19:15:270
2527829994012,10cyclictest2584859-21ssh21:24:060
2527829994010,13cyclictest2537833-21seq19:32:030
125899400,7rtkit-daemon2554901-21/usr/sbin/munin20:15:180
252782999399,12cyclictest2529053-21expr19:10:240
2527829993913,8cyclictest2691927-21sh23:59:100
2527829993911,17cyclictest2718206-21sh00:38:080
252782999388,11cyclictest2712428-21apt-get00:30:130
252782999386,12cyclictest2552398-21latency_hist20:10:010
2527829993811,10cyclictest2675257-21ssh23:34:520
125899380,3rtkit-daemon0-21swapper/123:43:471
125899380,3rtkit-daemon0-21swapper/023:27:561
252782999378,13cyclictest2548972-21seq20:00:190
252782999377,19cyclictest2564822-21cat20:40:230
252782999377,13cyclictest2686781-21systemctl23:50:250
252782999377,13cyclictest2578935-21sed21:15:220
2527829993723,7cyclictest2568095-21apt-get20:50:120
252782999371,12cyclictest0-21swapper/020:30:200
125899370,4rtkit-daemon0-21swapper/022:51:371
125899370,3rtkit-daemon0-21swapper/000:22:151
252782999368,17cyclictest2679116-21grep23:40:150
252782999368,11cyclictest2566728-21sed20:45:200
252782999368,10cyclictest2543348-21grep19:45:230
252782999367,13cyclictest2547626-21sed19:55:260
252782999367,11cyclictest2556550-21cstates20:20:180
252782999366,9cyclictest2552338-21cut20:10:000
252782999366,19cyclictest2573258-21cat21:05:200
125899360,6rtkit-daemon2591542-21ssh21:33:511
125899360,3rtkit-daemon0-21swapper/023:16:281
252782999357,11cyclictest2545258-21sed19:50:190
252782999356,12cyclictest0-21swapper/021:00:120
125899350,4rtkit-daemon1257-21rtkit-daemon23:31:101
125899350,4rtkit-daemon1257-21rtkit-daemon21:17:591
25512422340,1sleep12551241-21ntpq20:05:241
25512422340,1sleep12551241-21ntpq20:05:241
252782999345,18cyclictest0-21swapper/019:25:070
125899340,4rtkit-daemon2712428-21apt-get00:30:141
125899340,3rtkit-daemon0-21swapper/021:49:421
125899340,3rtkit-daemon0-21swapper/021:12:131
125899340,3rtkit-daemon0-21swapper/019:43:021
125899330,3rtkit-daemon1257-21rtkit-daemon23:35:311
125899330,3rtkit-daemon1257-21rtkit-daemon21:23:301
125899320,4rtkit-daemon0-21swapper/019:31:471
125899320,3rtkit-daemon0-21swapper/022:49:021
125899320,3rtkit-daemon0-21swapper/021:52:351
125899320,3rtkit-daemon0-21swapper/020:04:161
125899320,3rtkit-daemon0-21swapper/000:27:001
125899310,4rtkit-daemon0-21swapper/019:55:101
125899310,3rtkit-daemon0-21swapper/019:39:511
125899300,3rtkit-daemon0-21swapper/021:26:121
125899300,3rtkit-daemon0-21swapper/019:25:101
125899300,3rtkit-daemon0-21swapper/019:16:011
125899290,4rtkit-daemon1257-21rtkit-daemon22:44:051
125899290,3rtkit-daemon0-21swapper/020:44:551
125899290,3rtkit-daemon0-21swapper/019:47:011
125899290,3rtkit-daemon0-21swapper/019:11:491
125899280,3rtkit-daemon0-21swapper/021:55:281
125899280,3rtkit-daemon0-21swapper/000:08:411
2527834992713,12cyclictest26-21ksoftirqd/122:10:011
2527834992712,4cyclictest26-21ksoftirqd/100:38:081
125899270,3rtkit-daemon0-21swapper/021:09:311
125899270,2rtkit-daemon0-21swapper/019:23:531
2527834992613,2cyclictest141rcu_preempt22:58:231
252783499260,5cyclictest0-21swapper/120:39:331
2527834992510,5cyclictest0-21swapper/121:42:301
125899250,1rtkit-daemon1257-21rtkit-daemon20:17:501
252783499249,7cyclictest2665071-21apt-get23:20:171
252783499249,7cyclictest2665071-21apt-get23:20:161
252783499244,9cyclictest0-21swapper/100:03:391
2527834992410,8cyclictest63750irq/132-enp2s022:20:121
2527834992410,8cyclictest2627514-21apt-get22:25:151
252783499240,6cyclictest0-21swapper/122:35:481
125899240,19rtkit-daemon2527822-21cyclictest23:45:411
252783499239,2cyclictest141rcu_preempt23:54:221
252783499238,12cyclictest2654703-21apt-get23:05:131
252783499238,12cyclictest2630906-21apt-get22:30:131
252783499238,11cyclictest2620605-21apt-get22:15:131
125899230,4rtkit-daemon1257-21rtkit-daemon20:55:491
252783499223,11cyclictest2610485-21apt-get22:00:111
252783499221,6cyclictest0-21swapper/122:07:391
252783499221,16cyclictest26-21ksoftirqd/123:10:171
252783499220,6cyclictest0-21swapper/120:54:561
125899220,4rtkit-daemon1257-21rtkit-daemon21:00:221
125899220,14rtkit-daemon0-21swapper/120:21:231
125899220,14rtkit-daemon0-21swapper/120:14:231
252783499215,4cyclictest2558636-21grep20:25:181
252783499213,10cyclictest2560273-21apt-get20:30:151
252783499203,9cyclictest2699168-21apt-get00:10:141
252783499201,5cyclictest26-21ksoftirqd/123:58:081
2527834991914,3cyclictest2566370-21forks20:45:161
252783499191,15cyclictest26-21ksoftirqd/123:00:441
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional