You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 16:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Tue Sep 08, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
714799575,37cyclictest7671-21ssh10:30:150
7147995329,18cyclictest0-21swapper/011:35:130
7181994733,6cyclictest31060-21ssh10:25:122
715999463,30cyclictest2316-21ssh10:45:141
7147994631,9cyclictest9520-21apt-get09:55:140
7147994613,11cyclictest31029-21munin-node10:25:100
7147994538,3cyclictest25745-21apt-get09:10:120
7147994534,5cyclictest21844-21apt-get07:25:120
719899443,32cyclictest35966irq/58-eth011:45:153
7147994433,6cyclictest4161-21apt-get11:40:140
714799443,32cyclictest11281-21ssh09:20:130
7147994428,12cyclictest14945-21apt-get09:40:130
719899431,2cyclictest0-21swapper/311:15:133
7147994330,10cyclictest5092-21apt-get08:15:120
714799432,33cyclictest5895-21ssh11:05:120
7147994317,8cyclictest12186-21ssh09:37:110
714799431,33cyclictest11341-21ssh12:20:110
718199422,32cyclictest23806-21rm11:15:092
718199421,22cyclictest13067-21ssh10:15:162
715999424,29cyclictest9539-21ssh11:25:121
7147994229,8cyclictest16700-21ssh10:35:150
7147994216,10cyclictest26751-21ssh12:27:200
7147994215,10cyclictest25457-21ssh10:03:050
7147994214,7cyclictest30612-21munin-run10:25:010
715999411,26cyclictest16757-21ssh12:05:131
7147994135,3cyclictest12120-21apt-get07:15:130
7147994116,10cyclictest2245-21ssh09:31:040
7147994114,11cyclictest20802-21kthreadcore07:55:210
719899403,26cyclictest35966irq/58-eth011:50:113
715999403,21cyclictest23939-21ssh09:45:131
7147994015,11cyclictest28025-21ssh11:51:480
7147994015,10cyclictest7871-21ssh12:16:180
7147994015,10cyclictest13263-21sh12:38:290
7147993916,10cyclictest6306-21ssh11:58:500
7147993915,11cyclictest7099-21ssh11:22:340
7147993915,11cyclictest7099-21ssh11:22:330
7147993915,10cyclictest18538-21ssh11:46:110
719899382,2cyclictest0-21swapper/310:20:103
718199381,26cyclictest5938-21ssh12:35:132
7159993817,13cyclictest131rcu_preempt08:30:121
7147993816,10cyclictest30175-21ssh11:17:150
7147993815,9cyclictest29142-21sh09:45:560
7147993815,8cyclictest9426-21ssh09:18:160
7147993815,10cyclictest3665-21rm12:32:440
7147993814,8cyclictest25357-21diskmemload11:33:310
7147993814,10cyclictest19878-21ssh11:10:380
7147993812,8cyclictest16731-21apt-get12:05:140
7147993727,7cyclictest23110-21apt-get08:00:130
7147993726,9cyclictest20331-21apt-get09:25:140
714799371,32cyclictest25682-21ssh10:40:150
719899362,7cyclictest0-21swapper/311:35:133
719899362,29cyclictest0-21swapper/311:55:133
719899361,4cyclictest0-21swapper/311:20:133
719899361,4cyclictest0-21swapper/311:20:133
7181993623,8cyclictest27-21ksoftirqd/210:20:122
718199362,28cyclictest13944-21ssh09:39:172
715999361,27cyclictest445-21ssh09:50:131
7147993617,15cyclictest0-21swapper/011:00:140
7147993614,8cyclictest0-21swapper/008:45:220
7147993613,7cyclictest0-21swapper/012:11:510
7147993610,10cyclictest31580-21sed10:05:290
719899352,21cyclictest35966irq/58-eth008:25:143
719899351,2cyclictest0-21swapper/311:10:113
718199353,24cyclictest0-21swapper/210:40:172
718199353,18cyclictest27-21ksoftirqd/211:40:142
718199352,28cyclictest28389-21ssh09:29:182
7147993529,3cyclictest19532-21apt-get08:30:110
7147993515,8cyclictest17256-21ssh10:51:510
7147993514,8cyclictest7338-21ssh09:52:530
7147993511,9cyclictest23991-21ssh10:55:270
7147993511,9cyclictest23991-21ssh10:55:270
7198993418,8cyclictest35966irq/58-eth012:10:133
714799342,24cyclictest8273-21ps12:00:170
7147993421,9cyclictest27813-21kthreadcore07:30:230
7147993414,8cyclictest4042-21ssh10:10:160
719899334,21cyclictest0-21swapper/309:50:143
719899332,7cyclictest35966irq/58-eth011:05:123
719899331,2cyclictest0-21swapper/309:30:133
719899331,26cyclictest0-21swapper/312:00:143
715999333,19cyclictest201rcuc/109:35:151
7159993311,17cyclictest462-21ssh11:20:131
7159993311,17cyclictest462-21ssh11:20:121
7147993312,8cyclictest18470-21ssh10:16:130
719899321,3cyclictest0-21swapper/311:25:133
7147993219,10cyclictest9535-21apt-get11:25:120
719899313,2cyclictest0-21swapper/310:15:143
718199311,10cyclictest27559-21sh11:35:122
715999312,20cyclictest4094-21ssh10:10:181
7147993126,2cyclictest24316-21apt-get08:35:140
7147993126,2cyclictest16012-21apt-get09:00:130
7147993125,4cyclictest27922-21apt-get08:05:130
7147993125,3cyclictest6997-21apt-get07:10:050
7147993121,7cyclictest0-21swapper/007:20:130
7147993118,9cyclictest2540-21fschecks_time10:45:160
7147993118,9cyclictest10048-21diskstats08:20:160
7147993116,10cyclictest0-21swapper/008:50:110
719899302,3cyclictest0-21swapper/309:40:123
719899301,19cyclictest35966irq/58-eth010:30:153
718199303,20cyclictest0-21swapper/212:00:142
718199302,22cyclictest25735-21ssh12:10:132
7147993018,9cyclictest4076-21/usr/sbin/munin07:40:170
7147993018,9cyclictest11782-21sed08:55:160
7147993017,10cyclictest6984-21latency_hist07:10:020
7147993015,10cyclictest0-21swapper/007:35:100
7147993012,14cyclictest15913-21cut08:25:210
719899295,17cyclictest0-21swapper/310:40:153
719899292,3cyclictest0-21swapper/309:15:153
719899292,3cyclictest0-21swapper/307:15:133
719899292,22cyclictest35966irq/58-eth012:05:143
718199293,20cyclictest0-21swapper/210:32:182
718199292,11cyclictest13955-21ssh11:09:182
715999293,17cyclictest18480-21ssh10:00:111
715999292,22cyclictest14971-21ssh09:40:141
715999292,21cyclictest20368-21ssh12:25:121
7147992920,6cyclictest32652-21ntp_states08:40:260
7147992917,9cyclictest20837-21grep09:05:130
7147992916,10cyclictest12333-21sed07:45:280
7147992916,10cyclictest12333-21sed07:45:270
719899281,2cyclictest0-21swapper/308:05:133
718199283,16cyclictest27346irq/40-dwc2_hso10:45:132
718199282,20cyclictest19268-21irqstats11:30:182
7159992816,9cyclictest21-21ksoftirqd/111:55:181
715999281,22cyclictest4170-21ssh11:40:131
7159992810,4cyclictest21-21ksoftirqd/107:35:131
719899275,12cyclictest0-21swapper/309:20:133
719899272,2cyclictest0-21swapper/307:55:143
719899271,4cyclictest0-21swapper/308:15:123
719899271,4cyclictest0-21swapper/308:00:123
719899271,2cyclictest0-21swapper/310:55:163
719899271,2cyclictest0-21swapper/310:55:153
718199273,8cyclictest0-21swapper/211:25:182
718199272,19cyclictest25239-21cron10:40:012
718199271,17cyclictest29407-21ssh09:30:152
715999276,18cyclictest8274-21grep12:00:181
715999274,11cyclictest27676-21kworker/1:008:05:131
715999272,21cyclictest25357-21diskmemload10:50:151
715999272,17cyclictest0-21swapper/112:15:111
7159992714,8cyclictest0-21swapper/111:10:131
7147992711,13cyclictest15911-21kthreadcore07:50:200
719899262,3cyclictest0-21swapper/307:25:123
719899262,20cyclictest0-21swapper/309:40:013
719899261,6cyclictest0-21swapper/310:37:083
719899261,4cyclictest0-21swapper/308:45:143
719899261,4cyclictest0-21swapper/307:30:163
719899261,3cyclictest0-21swapper/312:35:123
719899261,3cyclictest0-21swapper/310:10:573
719899261,3cyclictest0-21swapper/308:20:133
719899261,16cyclictest35966irq/58-eth007:50:113
718199262,19cyclictest0-21swapper/211:04:182
718199262,10cyclictest0-21swapper/208:45:142
718199261,7cyclictest20362-21ssh12:25:132
718199261,18cyclictest27346irq/40-dwc2_hso11:55:132
718199261,10cyclictest2311-21sh09:15:152
715999262,19cyclictest11296-21ssh09:20:131
715999261,17cyclictest2312-21rm09:15:151
7147992617,6cyclictest0-21swapper/008:10:130
7147992617,6cyclictest0-21swapper/008:10:130
719899251,6cyclictest0-21swapper/307:45:013
719899251,5cyclictest0-21swapper/307:10:133
719899251,4cyclictest0-21swapper/309:25:143
719899251,3cyclictest0-21swapper/312:20:143
719899251,3cyclictest0-21swapper/311:00:173
719899251,3cyclictest0-21swapper/310:07:373
719899251,3cyclictest0-21swapper/310:01:303
719899251,2cyclictest0-21swapper/312:30:473
719899251,2cyclictest0-21swapper/311:30:233
719899251,2cyclictest0-21swapper/310:25:103
719899251,21cyclictest0-21swapper/310:50:193
719899250,3cyclictest0-21swapper/309:59:113
718199253,13cyclictest27346irq/40-dwc2_hso08:40:162
718199252,8cyclictest21276-21ssh09:42:182
715999252,19cyclictest26740-21rm09:27:191
715999251,5cyclictest131rcu_preempt08:00:111
715999251,14cyclictest29328-21ssh11:00:151
7159992511,3cyclictest131rcu_preempt11:00:011
7159992511,3cyclictest131rcu_preempt11:00:011
719899242,3cyclictest0-21swapper/308:35:143
719899241,6cyclictest0-21swapper/308:55:113
719899241,3cyclictest0-21swapper/312:25:223
719899241,3cyclictest0-21swapper/312:15:123
719899241,3cyclictest0-21swapper/310:45:133
719899241,3cyclictest0-21swapper/308:30:103
719899241,3cyclictest0-21swapper/307:35:243
719899241,2cyclictest0-21swapper/311:40:123
719899241,2cyclictest0-21swapper/309:45:133
719899241,20cyclictest0-21swapper/309:10:163
718199249,12cyclictest12097-21kthreadcore12:20:182
718199243,13cyclictest27346irq/40-dwc2_hso08:15:122
718199242,17cyclictest0-21swapper/209:59:192
718199242,15cyclictest0-21swapper/207:10:042
715999242,18cyclictest27549-21apt-get11:35:141
715999241,18cyclictest16711-21ssh10:35:161
715999241,14cyclictest21-21ksoftirqd/107:45:131
715999241,14cyclictest21-21ksoftirqd/107:45:131
719899231,3cyclictest0-21swapper/308:40:183
719899231,2cyclictest0-21swapper/309:05:293
719899231,2cyclictest0-21swapper/309:00:173
718199234,11cyclictest27346irq/40-dwc2_hso09:00:132
718199232,6cyclictest0-21swapper/209:22:182
718199232,16cyclictest0-21swapper/211:54:192
718199232,16cyclictest0-21swapper/210:12:172
718199232,16cyclictest0-21swapper/209:49:182
7181992312,9cyclictest1591-21ssh10:07:332
718199231,19cyclictest5837-21ls12:15:232
718199231,15cyclictest0-21swapper/208:30:112
718199230,20cyclictest24527-21ls09:05:292
715999232,16cyclictest18572-21ssh11:30:131
715999232,15cyclictest25757-21ssh09:10:121
715999232,11cyclictest25731-21ssh12:10:131
715999231,17cyclictest9548-21ssh09:55:131
719899221,6cyclictest0-21swapper/307:20:193
719899221,4cyclictest0-21swapper/307:45:143
719899221,4cyclictest0-21swapper/307:45:143
719899221,3cyclictest0-21swapper/308:50:273
719899221,3cyclictest0-21swapper/308:10:173
719899221,3cyclictest0-21swapper/308:10:173
718199225,9cyclictest28242-21grep08:05:172
718199223,9cyclictest0-21swapper/212:30:142
718199223,15cyclictest27346irq/40-dwc2_hso09:10:122
718199222,10cyclictest18508-21ssh10:00:122
718199221,8cyclictest20287-21diskmemload10:55:132
718199221,8cyclictest20287-21diskmemload10:55:132
718199221,12cyclictest4195-21ssh09:50:262
7181992210,9cyclictest10609-21kernelversion08:20:212
715999225,12cyclictest31058-21sh10:25:121
715999224,11cyclictest5885-21ssh11:05:121
715999223,13cyclictest0-21swapper/109:05:141
715999222,3cyclictest131rcu_preempt10:40:151
715999221,12cyclictest27436-21/usr/sbin/munin10:05:151
718199219,3cyclictest131rcu_preempt12:05:282
718199218,4cyclictest7142-21cyclictest07:25:132
718199216,7cyclictest7770-21kthreadcore08:50:182
718199213,11cyclictest27346irq/40-dwc2_hso08:25:152
718199211,17cyclictest17275-21ls07:50:272
718199211,11cyclictest13194-21sort11:45:152
718199211,11cyclictest12288-21cut10:50:192
718199211,10cyclictest891-21irqcore11:20:182
718199211,10cyclictest891-21irqcore11:20:182
718199211,10cyclictest26949-21kthreadcore08:35:222
715999219,3cyclictest131rcu_preempt12:20:251
7159992112,6cyclictest0-21swapper/108:55:131
715999211,16cyclictest24424-21cut08:35:171
718199203,10cyclictest12803-21kthreadcore07:15:202
718199202,15cyclictest23218-21fschecks_count08:00:152
718199202,11cyclictest12293-21wc07:45:282
718199202,11cyclictest12293-21wc07:45:282
718199201,9cyclictest11296-21fschecks_count08:55:142
718199201,15cyclictest20667-21wc07:20:282
718199201,11cyclictest14928-21ssh11:10:122
715999201,9cyclictest31924-21kthreadcore12:30:211
7159992011,6cyclictest30677-21sh11:55:011
719899191,4cyclictest0-21swapper/307:10:013
718199192,14cyclictest4646-21kthreadcore07:40:202
718199191,9cyclictest28228-21kthreadcore07:30:232
718199191,9cyclictest1225-21tr07:35:192
718199191,15cyclictest20925-21kthreadcore07:55:222
718199191,10cyclictest1510-21kthreadcore08:10:202
718199191,10cyclictest1510-21kthreadcore08:10:192
715999199,7cyclictest9072-21kthreadcore10:30:231
715999191,4cyclictest0-21swapper/109:30:541
715999191,15cyclictest28245-21usage_Anybus11:15:311
715999191,15cyclictest21927-21find10:20:101
7159991911,5cyclictest13430-21grep10:15:201
715999183,12cyclictest9905-21awk12:35:281
715999182,13cyclictest20723-21timerwakeupswit07:20:291
715999182,12cyclictest16834-21ntp_states11:45:271
7159991812,4cyclictest0-21swapper/108:50:111
7159991810,6cyclictest9301-21cat08:15:281
718199170,14cyclictest7245-21latency_hist07:10:022
715999176,9cyclictest1-21systemd07:54:291
715999176,8cyclictest6134-21cron08:50:011
715999175,9cyclictest10128-21fschecks_time08:20:181
715999175,10cyclictest31258-21kthreadcore08:40:231
715999174,10cyclictest11887-21cron07:15:011
715999173,11cyclictest21984-21fschecks_count07:25:151
715999171,7cyclictest28217-21kthreadcore07:30:221
7159991711,4cyclictest0-21swapper/107:15:261
715999170,14cyclictest14737-21apt-get08:25:131
715999165,8cyclictest6863-21kthreadcore07:40:231
715999164,9cyclictest3538-21cat08:10:231
715999164,9cyclictest3538-21cat08:10:221
715999162,10cyclictest0-21swapper/107:55:151
715999161,11cyclictest20563-21apt09:05:011
715999151,10cyclictest7192-21latency_hist07:10:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional