You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 05:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot8.osadl.org (updated Mon May 05, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
272872608583,16sleep00-21swapper/019:09:270
2738399496386,77cyclictest10261-21missed_timers19:50:201
2738299468360,77cyclictest0-21swapper/019:50:200
2738399438395,29cyclictest0-21swapper/119:10:161
2738299424346,39cyclictest27811-21df_abs19:10:160
271052299281,12sleep10-21swapper/119:07:331
1890621080,12sleep113-21rcu_preempt21:30:271
124872930,5sleep10-21swapper/100:09:051
216899920,5rtkit-daemon2167-21rtkit-daemon22:51:550
27382999128,44cyclictest0-21swapper/022:25:590
2738299795,68cyclictest0-21swapper/020:05:590
27382997824,33cyclictest0-21swapper/023:33:590
279692770,4sleep1271ktimersoftd/122:42:481
216899760,4rtkit-daemon2167-21rtkit-daemon20:35:420
2738299756,48cyclictest0-21swapper/022:35:590
2738399724,59cyclictest6053-21diskmemload00:30:001
27382997218,32cyclictest0-21swapper/023:05:590
2738399695,54cyclictest6564-21munin-node22:05:201
2738399694,55cyclictest4765-21munin-node19:35:191
2738399693,8cyclictest23898-21ntp_kernel_pll_22:35:251
2738399692,8cyclictest13837-21munin-node23:15:131
2738399687,55cyclictest78850irq/45-eth0-rx-22:55:331
2738399683,9cyclictest2883-21munin-node19:30:181
2738399683,8cyclictest29315-21gltestperf22:45:211
2738399676,54cyclictest0-21swapper/100:15:481
2738399672,57cyclictest22920-21sh22:35:001
2738399666,53cyclictest0-21swapper/122:25:361
2738399666,53cyclictest0-21swapper/122:10:341
2738399666,52cyclictest0-21swapper/123:09:501
2738399665,8cyclictest0-21swapper/121:39:441
2738399665,8cyclictest0-21swapper/100:14:141
2738399665,56cyclictest0-21swapper/100:02:471
2738399665,53cyclictest0-21swapper/121:20:541
2738399662,8cyclictest18376-21awk23:22:101
2738399662,7cyclictest1132-21timerandwakeup21:55:291
27383996616,43cyclictest0-21swapper/121:43:121
27382996630,22cyclictest0-21swapper/000:23:010
140302660,3chrt14032-21timerandwakeup00:10:280
2738399656,52cyclictest0-21swapper/123:00:131
2738399655,53cyclictest0-21swapper/122:00:171
2738399654,8cyclictest28200-21munin-node20:40:201
2738399654,54cyclictest32302-21kernelversion22:50:201
2738399654,53cyclictest14516-21munin-node22:20:191
2738399654,12cyclictest0-21swapper/123:50:111
2738399654,12cyclictest0-21swapper/100:31:571
2738399652,57cyclictest17584-21munin-node20:10:241
27382996518,40cyclictest0-21swapper/022:45:190
2738399649,46cyclictest2627-21munin-node21:00:181
2738399646,51cyclictest0-21swapper/119:55:161
2738399644,53cyclictest26206-21switchtime23:35:271
2738399644,13cyclictest0-21swapper/121:25:541
2738399643,9cyclictest25965-21munin-node20:35:141
2738399643,8cyclictest1394-21proc_pri19:25:251
2738399643,55cyclictest32049-21sed23:45:291
2738399642,8cyclictest14026-21munin-node20:00:251
2738399642,7cyclictest5569-21grep23:55:291
2738399642,55cyclictest31416-21munin-node20:50:151
2738399642,55cyclictest29453-21sh23:40:571
27382996415,33cyclictest0-21swapper/022:09:590
2738399633,7cyclictest6308-21munin-node21:10:131
2738399633,7cyclictest19507-21ntp_offset00:20:231
2738399633,6cyclictest11718-21aten_r1power_en22:15:151
2738399633,6cyclictest11687-21ssh23:10:241
2738399633,20cyclictest32290-21rm21:55:011
27383996321,35cyclictest22148-21ssh23:30:001
2738399632,8cyclictest24034-21latency_hist20:30:011
2738399632,6cyclictest9489-21latency_hist19:50:021
2738399632,54cyclictest9270-21munin-node21:15:151
2738399626,49cyclictest0-21swapper/121:05:231
2738399625,9cyclictest0-21swapper/119:20:221
2738399623,9cyclictest27481-21munin-node21:45:211
2738399623,9cyclictest18675-21munin-node20:15:171
2738399623,10cyclictest22882-21sh23:30:191
2738399622,8cyclictest1309-21latency20:55:221
27383996212,44cyclictest1139-21nscd00:35:181
2738399615,9cyclictest0-21swapper/120:30:201
2738399614,9cyclictest16185-21munin-node20:05:321
2738399614,8cyclictest30276-21munin-node20:45:251
27382996115,32cyclictest0-21swapper/021:16:000
27382996112,31cyclictest0-21swapper/022:10:280
2738399603,8cyclictest6371-21munin-node19:40:161
2738399602,8cyclictest30366-21munin-node19:15:271
27382996015,31cyclictest0-21swapper/020:32:590
27382996015,29cyclictest0-21swapper/021:52:000
27382996014,31cyclictest0-21swapper/020:19:000
27382996014,30cyclictest0-21swapper/020:45:590
2738399593,9cyclictest20718-21munin-node20:20:181
27382995934,19cyclictest0-21swapper/023:57:320
27382995929,23cyclictest0-21swapper/022:00:100
27382995915,30cyclictest0-21swapper/021:21:590
27382995914,34cyclictest0-21swapper/020:43:590
27382995914,32cyclictest0-21swapper/020:10:590
27382995831,16cyclictest0-21swapper/021:35:270
27382995826,25cyclictest0-21swapper/021:05:240
27382995814,30cyclictest0-21swapper/021:32:590
2738299578,43cyclictest0-21swapper/021:10:440
2738299575,46cyclictest0-21swapper/019:45:240
2738299575,45cyclictest0-21swapper/022:24:370
27382995723,27cyclictest0-21swapper/023:51:090
27382995713,30cyclictest0-21swapper/020:53:590
2738299565,32cyclictest0-21swapper/021:30:010
27382995629,20cyclictest0-21swapper/020:01:530
27382995622,14cyclictest0-21swapper/000:03:360
27382995614,30cyclictest0-21swapper/019:56:590
27382995613,32cyclictest0-21swapper/023:15:590
27382995612,37cyclictest0-21swapper/022:00:020
2738299555,43cyclictest0-21swapper/021:46:240
2738299555,17cyclictest0-21swapper/022:31:180
27382995529,16cyclictest0-21swapper/020:26:010
27382995518,27cyclictest0-21swapper/000:05:170
27382995516,34cyclictest0-21swapper/023:25:130
27382995516,27cyclictest0-21swapper/023:40:590
27382995514,30cyclictest0-21swapper/019:37:590
27382995514,28cyclictest0-21swapper/000:35:000
27382995512,29cyclictest0-21swapper/022:18:590
27382995512,27cyclictest0-21swapper/022:55:270
27382995511,39cyclictest0-21swapper/022:40:010
216899550,4rtkit-daemon2167-21rtkit-daemon00:29:060
27382995423,23cyclictest0-21swapper/023:01:060
27382995414,28cyclictest0-21swapper/023:22:590
27382995414,28cyclictest0-21swapper/023:12:000
27382995414,28cyclictest0-21swapper/000:16:000
27382995411,38cyclictest0-21swapper/021:05:010
216899540,4rtkit-daemon2167-21rtkit-daemon23:37:050
2738299535,41cyclictest0-21swapper/020:20:580
2738299535,41cyclictest0-21swapper/000:35:070
27382995313,30cyclictest0-21swapper/019:42:000
27382995313,30cyclictest0-21swapper/019:21:000
27382995313,26cyclictest0-21swapper/019:19:000
2738299525,41cyclictest0-21swapper/021:44:090
27382995230,16cyclictest0-21swapper/023:47:500
216899520,5rtkit-daemon2167-21rtkit-daemon19:30:160
27382995011,27cyclictest0-21swapper/019:25:590
27382994912,27cyclictest0-21swapper/020:57:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional