You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 08:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Wed Jun 10, 2026 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31564996128,19cyclictest35966irq/58-eth021:35:133
31564996128,19cyclictest35966irq/58-eth021:35:123
3154599526,41cyclictest14482-21ssh22:20:151
31537995118,2cyclictest131rcu_preempt21:25:130
31537995118,2cyclictest131rcu_preempt21:25:120
3156499467,22cyclictest35966irq/58-eth022:05:133
3156499463,26cyclictest35966irq/58-eth022:35:123
3156499455,26cyclictest35966irq/58-eth023:45:133
3153799453,12cyclictest12-21ksoftirqd/021:55:140
31537994316,3cyclictest131rcu_preempt00:05:170
3153799430,37cyclictest18246-21ssh00:10:130
3156499392,22cyclictest35966irq/58-eth000:10:133
31564993821,8cyclictest0-21swapper/323:35:123
3154599388,6cyclictest131rcu_preempt22:35:121
3153799371,24cyclictest5444-21ssh22:15:130
3155699361,32cyclictest0-21swapper/222:55:132
3153799364,3cyclictest131rcu_preempt22:20:120
3156499351,22cyclictest35966irq/58-eth022:20:133
3156499343,18cyclictest35966irq/58-eth022:00:113
3156499343,16cyclictest35966irq/58-eth000:05:173
3156499342,16cyclictest35966irq/58-eth023:55:153
31556993426,5cyclictest14585-21ssh23:50:142
3156499334,19cyclictest35966irq/58-eth022:30:123
3156499333,20cyclictest35966irq/58-eth021:40:123
3153799334,7cyclictest12-21ksoftirqd/020:35:140
3156499327,18cyclictest35966irq/58-eth023:20:133
3156499323,16cyclictest35966irq/58-eth020:25:113
3156499322,18cyclictest35966irq/58-eth022:55:143
3154599320,21cyclictest11087-21ssh23:30:131
31537993216,11cyclictest131rcu_preempt22:05:140
3156499318,13cyclictest35966irq/58-eth019:50:133
3155699313,24cyclictest18069-21ssh22:40:132
3154599311,25cyclictest26579-21ssh21:15:171
3153799315,3cyclictest131rcu_preempt22:25:120
3153799315,3cyclictest131rcu_preempt22:25:110
3153799314,7cyclictest12-21ksoftirqd/000:00:120
31537993115,3cyclictest131rcu_preempt23:40:150
31537993115,3cyclictest131rcu_preempt23:40:140
3156499301,15cyclictest35966irq/58-eth022:45:133
31556993010,7cyclictest27-21ksoftirqd/200:11:162
3153799308,17cyclictest12-21ksoftirqd/000:20:120
3156499296,17cyclictest35966irq/58-eth000:15:143
3156499291,13cyclictest35966irq/58-eth020:50:133
31556992918,8cyclictest0-21swapper/200:25:142
3153799292,3cyclictest131rcu_preempt21:15:150
31537992921,4cyclictest151rcuc/021:10:130
3155699287,11cyclictest27-21ksoftirqd/222:01:442
3155699282,22cyclictest19799-21ssh22:05:132
31556992819,4cyclictest0-21swapper/220:00:122
31556992812,11cyclictest31524-21cyclictest22:25:142
31556992812,11cyclictest31524-21cyclictest22:25:132
3155699281,13cyclictest32465-21ssh22:30:142
3154599289,8cyclictest31524-21cyclictest19:10:101
3153799289,2cyclictest12-21ksoftirqd/021:50:140
3153799287,4cyclictest131rcu_preempt22:50:110
3156499274,14cyclictest0-21swapper/322:10:123
3155699279,11cyclictest27-21ksoftirqd/222:36:252
3155699273,20cyclictest930-21snmpd19:15:132
3155699272,17cyclictest27346irq/40-dwc2_hso21:25:142
3155699272,17cyclictest27346irq/40-dwc2_hso21:25:132
3155699271,20cyclictest0-21swapper/221:50:132
31556992711,4cyclictest27-21ksoftirqd/223:38:022
3154599270,18cyclictest21-21ksoftirqd/119:30:121
3153799278,4cyclictest131rcu_preempt22:55:150
3156499262,18cyclictest35966irq/58-eth023:50:133
3155699269,5cyclictest27-21ksoftirqd/222:54:532
3155699268,8cyclictest27-21ksoftirqd/221:14:522
3155699265,6cyclictest131rcu_preempt00:36:292
3155699265,10cyclictest27-21ksoftirqd/223:18:242
3155699264,2cyclictest131rcu_preempt23:30:142
3155699264,2cyclictest131rcu_preempt22:49:192
3155699263,19cyclictest2075-21ssh23:25:142
3155699261,17cyclictest15902-21ls21:05:232
3155699261,13cyclictest28187-21cut19:40:162
31556992610,5cyclictest27-21ksoftirqd/221:37:342
31556992610,5cyclictest27-21ksoftirqd/221:37:332
31556992610,4cyclictest27-21ksoftirqd/223:14:392
3155699260,5cyclictest27-21ksoftirqd/223:40:132
3155699260,5cyclictest27-21ksoftirqd/223:40:122
3154599267,7cyclictest21-21ksoftirqd/100:00:131
3154599267,3cyclictest17133-21diskmemload21:35:211
3154599267,3cyclictest17133-21diskmemload21:35:201
3154599263,14cyclictest0-21swapper/122:49:301
3154599262,14cyclictest0-21swapper/122:15:001
31545992613,6cyclictest0-21swapper/122:30:041
3154599261,15cyclictest0-21swapper/123:20:251
3154599261,11cyclictest0-21swapper/121:52:381
3154599260,18cyclictest16446-21ssh23:15:131
3153799266,5cyclictest12-21ksoftirqd/000:35:110
3153799263,9cyclictest12-21ksoftirqd/023:30:130
3153799261,8cyclictest28727-21cut00:15:220
31537992615,8cyclictest131rcu_preempt20:25:150
3156499251,11cyclictest35966irq/58-eth019:15:133
3155699257,14cyclictest18463-21apt-get19:30:132
3155699256,15cyclictest27346irq/40-dwc2_hso21:00:122
3155699255,3cyclictest131rcu_preempt23:05:122
3155699252,17cyclictest27346irq/40-dwc2_hso00:30:132
3155699252,17cyclictest27346irq/40-dwc2_hso00:30:122
31556992518,5cyclictest27-21ksoftirqd/220:15:122
31556992514,8cyclictest27-21ksoftirqd/221:45:162
31556992511,4cyclictest27-21ksoftirqd/221:18:282
3155699251,10cyclictest5679-21timerandwakeup21:55:292
3154599254,15cyclictest22457-21kworker/1:023:58:531
3154599253,3cyclictest131rcu_preempt21:25:131
3154599253,3cyclictest131rcu_preempt21:25:121
3154599253,15cyclictest0-21swapper/122:58:421
3154599252,17cyclictest30651-21ssh00:35:111
3154599251,8cyclictest0-21swapper/122:15:471
3154599251,19cyclictest24869-21ls21:50:031
3154599250,17cyclictest1373-21kworker/1:020:20:211
3153799257,3cyclictest12-21ksoftirqd/020:15:220
3153799254,7cyclictest12-21ksoftirqd/019:35:140
3153799251,7cyclictest32361-21kthreadcore20:50:210
31537992514,3cyclictest12-21ksoftirqd/023:14:070
31537992510,4cyclictest12-21ksoftirqd/023:25:010
3156499242,15cyclictest35966irq/58-eth022:40:123
3155699248,7cyclictest131rcu_preempt00:18:162
3155699245,12cyclictest27346irq/40-dwc2_hso20:05:112
3155699244,5cyclictest27-21ksoftirqd/200:00:042
3155699243,13cyclictest27346irq/40-dwc2_hso19:50:122
3155699242,18cyclictest21364-21ssh21:30:132
3155699242,13cyclictest0-21swapper/219:35:142
3155699241,15cyclictest0-21swapper/220:45:122
3155699241,10cyclictest417866ssh21:20:202
3154599246,12cyclictest131rcu_preempt21:55:131
3154599244,12cyclictest131rcu_preempt22:01:591
31545992414,4cyclictest0-21swapper/123:45:141
3154599241,15cyclictest12787-21kworker/1:000:28:551
3153799248,7cyclictest3849-21ssh22:13:330
3153799247,3cyclictest131rcu_preempt19:45:150
3153799243,3cyclictest131rcu_preempt23:15:140
31537992412,3cyclictest12-21ksoftirqd/023:55:200
31537992412,3cyclictest12-21ksoftirqd/021:35:210
31537992412,3cyclictest12-21ksoftirqd/021:35:200
31537992410,2cyclictest12-21ksoftirqd/021:49:320
31564992311,9cyclictest0-21swapper/300:30:153
31564992311,9cyclictest0-21swapper/300:30:143
31564992310,10cyclictest0-21swapper/321:45:203
3155699239,3cyclictest131rcu_preempt21:45:012
3155699238,7cyclictest14868-21irqcore22:20:192
3155699236,9cyclictest24624-21cut23:00:212
3155699233,6cyclictest27-21ksoftirqd/219:55:152
3155699232,12cyclictest27346irq/40-dwc2_hso20:55:142
3155699231,9cyclictest27-21ksoftirqd/223:22:482
31556992313,8cyclictest0-21swapper/223:47:412
31556992312,4cyclictest0-21swapper/222:17:572
3154599239,3cyclictest22160-21irqcore00:30:181
3154599239,3cyclictest22160-21irqcore00:30:171
3154599235,12cyclictest28358-21kworker/1:223:04:101
3154599235,12cyclictest131rcu_preempt23:50:271
31545992312,8cyclictest20588-21cron20:40:001
3154599231,16cyclictest17584-21kworker/1:100:09:561
3154599231,16cyclictest12285-21kworker/1:221:05:311
3154599231,15cyclictest29519-21kworker/1:022:28:531
3154599231,15cyclictest29519-21kworker/1:022:28:521
3154599231,15cyclictest17539-21ssh21:10:131
31545992311,4cyclictest0-21swapper/122:07:341
31545992310,7cyclictest0-21swapper/121:23:261
3154599230,17cyclictest7304-21ssh23:10:131
3153799239,5cyclictest12-21ksoftirqd/021:30:370
3153799235,4cyclictest131rcu_preempt19:15:110
3153799233,4cyclictest12-21ksoftirqd/020:10:150
3153799232,5cyclictest12-21ksoftirqd/019:55:020
3153799232,4cyclictest131rcu_preempt23:05:170
31537992318,3cyclictest151rcuc/020:05:110
31537992312,3cyclictest12-21ksoftirqd/023:29:060
31537992311,4cyclictest12-21ksoftirqd/021:40:260
31537992311,3cyclictest12-21ksoftirqd/022:30:220
31537992311,3cyclictest12-21ksoftirqd/000:30:190
31537992311,3cyclictest12-21ksoftirqd/000:30:180
31537992310,7cyclictest0-21swapper/023:50:250
3153799230,6cyclictest18038-21/usr/sbin/munin22:40:150
3156499223,12cyclictest0-21swapper/321:50:123
3155699228,10cyclictest9313-21sh00:05:172
3155699227,7cyclictest27-21ksoftirqd/200:20:102
3155699221,15cyclictest23643-21ssh23:55:152
3154599224,6cyclictest131rcu_preempt23:28:001
3154599224,6cyclictest11241-21kthreadcore19:55:201
3154599222,16cyclictest4027-21apt-get19:15:121
3154599221,3cyclictest131rcu_preempt00:19:181
31545992212,4cyclictest0-21swapper/123:08:521
3154599221,15cyclictest0-21swapper/121:31:431
3154599221,12cyclictest19040-21kthreadcore22:40:201
3154599221,11cyclictest28247-21kthreadcore20:45:201
31545992210,6cyclictest0-21swapper/100:11:331
3154599220,12cyclictest7164-21ssh21:40:121
3153799229,3cyclictest12-21ksoftirqd/023:45:250
3153799228,2cyclictest12-21ksoftirqd/019:20:210
3153799226,12cyclictest12-21ksoftirqd/021:05:130
3153799224,7cyclictest131rcu_preempt20:55:200
3153799224,4cyclictest131rcu_preempt20:20:190
3153799221,2cyclictest131rcu_preempt22:45:130
31537992212,3cyclictest12-21ksoftirqd/019:40:200
3153799221,18cyclictest10763-21ssh22:00:120
31537992211,3cyclictest12-21ksoftirqd/023:35:210
31537992211,3cyclictest12-21ksoftirqd/020:00:310
31537992211,3cyclictest12-21ksoftirqd/000:25:130
3155699215,3cyclictest131rcu_preempt19:25:272
3155699212,9cyclictest11392-21sort20:30:162
3155699212,17cyclictest0-21swapper/220:50:142
3155699212,10cyclictest12733-21usage_Anybus19:20:312
3155699211,12cyclictest32261-21irqrtprio19:10:172
3155699211,10cyclictest28958-21df_inode22:10:152
31556992110,8cyclictest27-21ksoftirqd/220:20:112
3154599217,3cyclictest29287-21fschecks_time23:40:171
3154599217,3cyclictest29287-21fschecks_time23:40:161
3154599214,7cyclictest12487-21cp00:25:021
3154599213,11cyclictest131rcu_preempt19:45:171
3154599211,13cyclictest19683-21find20:05:101
3154599211,11cyclictest0-21swapper/120:00:241
3154599211,10cyclictest0-21swapper/122:51:551
3154599210,5cyclictest9906-21cat19:55:011
3153799219,3cyclictest12-21ksoftirqd/019:25:210
3153799218,3cyclictest12-21ksoftirqd/022:35:150
3153799216,7cyclictest12-21ksoftirqd/019:10:240
3153799216,3cyclictest26324-21kthreadcore20:45:190
3153799211,4cyclictest131rcu_preempt20:40:130
3153799211,14cyclictest3224-21ssh21:20:140
3156499206,9cyclictest35966irq/58-eth023:00:123
3156499206,11cyclictest0-21swapper/321:55:143
3156499203,11cyclictest0-21swapper/323:40:153
3156499203,11cyclictest0-21swapper/323:40:143
3156499202,10cyclictest35966irq/58-eth023:10:123
3155699204,6cyclictest131rcu_preempt20:40:112
3155699201,9cyclictest5169-21latency_hist19:50:022
3155699201,9cyclictest19787-21timerwakeupswit20:35:302
3154599207,4cyclictest131rcu_preempt23:35:311
3154599200,10cyclictest11390-21grep20:30:171
3153799209,3cyclictest12-21ksoftirqd/019:55:290
3153799207,5cyclictest12-21ksoftirqd/020:30:130
3153799201,4cyclictest131rcu_preempt23:00:120
31537992014,4cyclictest0-21swapper/019:30:190
3156499192,10cyclictest35966irq/58-eth019:55:143
3156499191,13cyclictest0-21swapper/321:10:013
31564991910,6cyclictest35966irq/58-eth023:05:133
31564991910,6cyclictest0-21swapper/321:29:433
31564991910,6cyclictest0-21swapper/321:29:423
31564991910,6cyclictest0-21swapper/300:00:203
3155699191,9cyclictest7205-21kthreadcore20:25:192
3155699191,10cyclictest25928-21kthreadcore20:10:192
3154599199,4cyclictest24718-21kthreadcore19:35:221
3154599195,5cyclictest131rcu_preempt20:55:241
31545991913,4cyclictest0-21swapper/120:50:181
3154599191,12cyclictest0-21swapper/119:40:181
3154599191,10cyclictest91-21pr/ttyS021:05:011
3154599191,10cyclictest24264-21ntp_kernel_err20:40:251
3154599191,10cyclictest1384-21run-parts20:17:011
3154599191,10cyclictest11683-21cut19:20:231
31537991913,3cyclictest12-21ksoftirqd/021:00:260
3156499189,6cyclictest35966irq/58-eth023:30:133
3156499189,6cyclictest0-21swapper/322:26:403
3156499189,6cyclictest0-21swapper/322:26:403
3156499189,5cyclictest35966irq/58-eth023:25:113
3156499188,7cyclictest35966irq/58-eth000:20:133
3156499188,3cyclictest0-21swapper/323:15:333
3156499182,10cyclictest0-21swapper/321:00:143
3156499182,10cyclictest0-21swapper/320:40:143
3156499181,14cyclictest0-21swapper/322:50:153
3156499181,13cyclictest0-21swapper/322:15:233
31564991810,6cyclictest0-21swapper/321:10:343
31564991810,6cyclictest0-21swapper/300:25:133
3155699181,9cyclictest31570-21latency_hist19:10:012
3154599181,9cyclictest31628-21sed19:10:021
3154599181,3cyclictest0-21swapper/120:10:311
3154599181,11cyclictest0-21swapper/120:25:231
3154599181,11cyclictest0-21swapper/119:25:131
3156499179,6cyclictest0-21swapper/321:21:283
3156499179,3cyclictest0-21swapper/321:31:123
3156499172,9cyclictest0-21swapper/319:35:163
3156499172,10cyclictest0-21swapper/320:35:143
3156499172,10cyclictest0-21swapper/320:20:143
3156499172,10cyclictest0-21swapper/319:20:153
3156499171,10cyclictest0-21swapper/300:35:223
31564991710,5cyclictest0-21swapper/321:15:173
3156499162,10cyclictest0-21swapper/320:30:153
3156499162,10cyclictest0-21swapper/320:00:133
3156499161,8cyclictest0-21swapper/319:15:013
3156499152,7cyclictest0-21swapper/320:05:123
3156499151,9cyclictest0-21swapper/319:30:163
3156499149,3cyclictest0-21swapper/319:26:183
3156499142,10cyclictest0-21swapper/320:55:133
3156499131,10cyclictest0-21swapper/319:45:213
3156499130,9cyclictest0-21swapper/320:45:133
3156499127,3cyclictest0-21swapper/319:40:283
3156499122,6cyclictest0-21swapper/320:10:143
3153799120,9cyclictest31548-21latency_hist19:10:000
3156499111,8cyclictest0-21swapper/320:15:013
315649991,6cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional