You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 09:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sat Aug 15, 2026 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82239912723,79cyclictest0-21swapper/021:20:210
82239912527,72cyclictest26210-21missed_timers23:15:250
82239911328,54cyclictest14717-21pluginstate23:40:300
8225991112,27cyclictest26270-21chrt23:15:262
8223991034,9cyclictest0-21swapper/022:07:500
8223991034,9cyclictest0-21swapper/022:07:500
82239910234,61cyclictest6359-21ssh00:10:100
8223991014,80cyclictest12230-21fschecks_time21:40:230
82239910114,47cyclictest0-21swapper/000:15:260
82239910032,45cyclictest16753-21ssh21:45:290
8223999720,61cyclictest13786-21unixbench_singl22:20:320
166112960,3sleep123-21ksoftirqd/123:43:101
822599943,24cyclictest0-21swapper/221:40:222
130962920,4sleep113098-21grep21:40:361
8223999016,50cyclictest10241-21grep20:45:180
8223998917,51cyclictest25251-21apt23:15:050
8223998916,49cyclictest19493-21missed_timers00:25:270
822399887,66cyclictest0-21swapper/023:45:100
8223998720,54cyclictest21201-21threads21:50:320
8223998555,15cyclictest0-21swapper/022:00:190
8226998329,35cyclictest6122-21kworker/3:223:15:243
822399836,42cyclictest0-21swapper/021:25:170
8223998318,49cyclictest0-21swapper/023:50:160
8223998313,55cyclictest614850ssh22:50:330
47152810,6sleep1822499cyclictest23:29:131
125462810,2sleep00-21swapper/023:38:260
822399786,57cyclictest30135-21rm00:38:470
8223997815,49cyclictest0-21swapper/021:39:310
8223997811,43cyclictest489-21modprobe22:45:050
291882780,2sleep20-21swapper/200:37:022
8225997714,43cyclictest9320-21kworker/u8:300:10:112
822499774,37cyclictest28070-21entropy21:20:211
822399779,56cyclictest0-21swapper/020:21:080
822399779,53cyclictest140-21systemd-journal21:01:280
8223997618,42cyclictest8048-21awk22:15:040
8223997617,43cyclictest14345-21cat23:00:330
8223997615,41cyclictest0-21swapper/022:15:210
6582760,2sleep20-21swapper/223:24:232
8223997512,43cyclictest28149-21aten_rbpower_en20:05:190
19692740,1sleep20-21swapper/222:45:302
8223997316,34cyclictest3383-21sort20:25:240
8223997315,45cyclictest26033-21ssh00:33:470
8223997314,44cyclictest22192-21seq19:46:590
822499724,32cyclictest0-21swapper/123:15:261
822399729,49cyclictest0-21swapper/022:39:380
8223997218,44cyclictest23731-21basename21:15:190
8223997215,46cyclictest30773-21timerandwakeup23:20:310
8223997214,43cyclictest26127-21ls20:00:050
8223997214,42cyclictest19387-21ssh23:06:540
52102720,1sleep20-21swapper/221:31:022
8223997137,5cyclictest0-21swapper/021:05:170
8223997117,11cyclictest31031-21/usr/sbin/munin20:10:330
822599703,47cyclictest11325-21ssh00:15:272
8223997020,28cyclictest8734-21rm23:34:010
8223997011,45cyclictest0-21swapper/021:55:310
8226996932,14cyclictest7850irq/56-dwc_otg_21:45:283
8223996914,42cyclictest26526-21/usr/sbin/munin20:00:230
8223996914,42cyclictest26526-21/usr/sbin/munin20:00:230
8223996912,41cyclictest0-21swapper/023:58:440
8223996813,39cyclictest22650-21ssh22:31:250
8223996812,41cyclictest0-21swapper/000:20:190
8223996810,48cyclictest0-21swapper/019:52:110
8223996810,44cyclictest0-21swapper/023:28:350
8225996720,31cyclictest0-21swapper/221:20:222
8223996718,35cyclictest32048-21ssh00:01:060
8223996717,36cyclictest1708-21/usr/sbin/munin22:45:280
8223996713,41cyclictest0-21swapper/021:30:250
8223996710,49cyclictest10636-21rm22:56:000
8225996615,31cyclictest0-21swapper/221:45:332
8223996630,5cyclictest0-21swapper/020:30:140
8223996614,42cyclictest7817-21taskset20:37:130
8223996612,38cyclictest11319-21runrttasks19:16:320
8223996612,38cyclictest11319-21runrttasks19:16:320
8223996611,42cyclictest16946-21seq19:34:070
8226996513,20cyclictest7850irq/56-dwc_otg_00:15:273
8223996524,24cyclictest0-21swapper/019:10:070
8223996512,38cyclictest21720-21ssh21:12:140
8223996512,37cyclictest0-21swapper/000:06:290
8223996511,41cyclictest0-21swapper/020:40:120
8223996511,41cyclictest0-21swapper/020:40:120
822699646,36cyclictest7950irq/56-dwc_otg_23:40:293
822399649,36cyclictest0-21swapper/019:24:120
822699638,36cyclictest7750irq/56-dwc_otg00:10:113
822399638,35cyclictest19705-21ssh22:28:460
199382630,2sleep10-21swapper/121:50:061
822699626,36cyclictest7950irq/56-dwc_otg_21:40:213
822699625,22cyclictest39-21ksoftirqd/321:20:223
8223996211,40cyclictest13211-21taskset20:50:390
822499603,29cyclictest0-21swapper/100:15:301
822399609,40cyclictest0-21swapper/020:56:040
8224995914,26cyclictest7950irq/56-dwc_otg_00:10:111
8223995911,32cyclictest20578-21chrt19:44:290
8223995818,26cyclictest473-21runrttasks20:16:130
8223995811,35cyclictest0-21swapper/019:35:190
193572570,2sleep20-21swapper/222:28:072
285272550,2sleep20-21swapper/220:05:242
8224995322,7cyclictest7950irq/56-dwc_otg_23:20:161
8223995313,28cyclictest0-21swapper/019:29:010
8226995217,7cyclictest0-21swapper/323:20:173
822599514,31cyclictest0-21swapper/223:40:302
822499508,28cyclictest0-21swapper/122:30:121
822499502,11cyclictest0-21swapper/122:10:161
822699483,8cyclictest39-21ksoftirqd/319:10:083
822599488,25cyclictest0-21swapper/221:05:192
822599481,6cyclictest31-21ksoftirqd/200:05:162
822699479,27cyclictest0-21swapper/323:30:183
822599472,11cyclictest30445-21ssh00:00:172
8224994727,6cyclictest7950irq/56-dwc_otg_23:45:181
8224994718,6cyclictest2156-21sh00:05:111
822699467,24cyclictest0-21swapper/320:00:193
822699467,24cyclictest0-21swapper/320:00:193
822599467,24cyclictest0-21swapper/220:45:182
822599467,24cyclictest0-21swapper/220:30:162
8226994523,12cyclictest39-21ksoftirqd/300:05:163
822599457,23cyclictest0-21swapper/219:20:182
822599456,25cyclictest20887-21ssh22:30:182
76752452,35sleep00-21swapper/019:06:280
822599447,22cyclictest0-21swapper/220:55:182
8225994438,4cyclictest19101-21diskmemload22:35:232
822499449,18cyclictest7750irq/56-dwc_otg20:10:191
822699437,24cyclictest0-21swapper/322:35:193
822599437,23cyclictest0-21swapper/220:20:182
822599437,22cyclictest0-21swapper/219:45:152
8224994320,4cyclictest20709-21apt-config22:30:061
822699427,24cyclictest0-21swapper/319:35:173
822699426,19cyclictest39-21ksoftirqd/323:55:313
8226994217,10cyclictest7950irq/56-dwc_otg_23:05:283
822599426,22cyclictest18029-21ssh23:45:112
822499428,20cyclictest0-21swapper/119:10:081
822499427,6cyclictest7950irq/56-dwc_otg_21:55:171
822499423,13cyclictest0-21swapper/120:35:201
822599417,23cyclictest0-21swapper/220:00:192
822599417,23cyclictest0-21swapper/220:00:192
822499418,16cyclictest9083-21rm22:55:161
8226994021,4cyclictest1180-21runrttasks21:10:213
822699401,24cyclictest23515-21ssh21:54:163
822599409,23cyclictest19440-21ssh21:10:162
822599407,25cyclictest0-21swapper/221:00:112
8224994019,5cyclictest10486-21fschecks_count20:45:221
8224994018,4cyclictest12332-21uname19:20:241
8224994016,13cyclictest0-21swapper/120:45:061
8224994016,13cyclictest0-21swapper/120:45:061
822699393,17cyclictest7850irq/56-dwc_otg_21:20:063
822699392,3cyclictest0-21swapper/321:35:303
822699392,3cyclictest0-21swapper/319:45:143
8226993915,11cyclictest7950irq/56-dwc_otg_00:22:083
822599398,16cyclictest0-21swapper/219:50:182
822599397,18cyclictest8222-21cyclictest19:10:072
8225993931,5cyclictest18504-21sh00:25:042
822499393,6cyclictest0-21swapper/119:50:161
8224993921,5cyclictest21-21rcuc/122:45:141
822499391,23cyclictest0-21swapper/120:15:181
8224993910,8cyclictest7850irq/56-dwc_otg_21:05:051
138072391,32sleep10-21swapper/120:55:161
822699385,24cyclictest9685-21ssh23:35:193
822499388,4cyclictest0-21swapper/100:03:391
822499383,6cyclictest5303-21tune2fs22:50:221
8224993811,8cyclictest0-21swapper/121:30:311
822599377,21cyclictest0-21swapper/223:05:182
822599376,15cyclictest7850irq/56-dwc_otg_23:00:052
8225993718,4cyclictest301ktimersoftd/221:27:112
822599371,25cyclictest22130-21grep23:10:252
822599371,25cyclictest10803-21ls23:35:332
822499374,16cyclictest5873-21perl23:30:221
822499371,9cyclictest22207-21/usr/sbin/munin23:10:261
83372360,2sleep2822599cyclictest23:33:172
8226993613,12cyclictest27518-21ssh00:35:233
8226993610,11cyclictest0-21swapper/321:25:143
822599368,15cyclictest7950irq/56-dwc_otg_23:50:332
822599367,25cyclictest0-21swapper/221:50:112
822599367,19cyclictest0-21swapper/219:35:172
822599364,9cyclictest7950irq/56-dwc_otg_22:50:172
822499369,7cyclictest0-21swapper/120:31:541
822499365,6cyclictest7850irq/56-dwc_otg_21:15:061
48072360,1sleep30-21swapper/320:30:173
822699357,15cyclictest0-21swapper/320:05:193
822699351,19cyclictest17810-21cut21:05:223
8226993511,7cyclictest23505-21head23:50:333
822599357,24cyclictest0-21swapper/220:35:212
822599355,17cyclictest7850irq/56-dwc_otg_20:43:222
822599355,17cyclictest7850irq/56-dwc_otg_20:43:222
822499352,7cyclictest7750irq/56-dwc_otg20:25:161
822499352,5cyclictest0-21swapper/120:20:171
8224993521,5cyclictest19100-21idleruntime-cro21:10:051
822499351,28cyclictest13457-21switchtime22:20:301
822499351,25cyclictest0-21swapper/123:06:431
132202351,31sleep113230-21ssh23:39:411
822699347,14cyclictest7850irq/56-dwc_otg_22:55:313
822699345,13cyclictest7950irq/56-dwc_otg_19:30:203
822699344,5cyclictest7950irq/56-dwc_otg_20:35:213
822699344,16cyclictest7950irq/56-dwc_otg_22:05:323
822699344,16cyclictest7950irq/56-dwc_otg_22:05:323
822699342,6cyclictest0-21swapper/322:21:143
822699342,12cyclictest7950irq/56-dwc_otg_21:55:193
822599347,14cyclictest0-21swapper/219:40:182
822599341,8cyclictest15557-21wget19:30:172
8225993417,4cyclictest993-21latency_hist20:20:052
822599341,24cyclictest689-21ls22:05:242
822599341,24cyclictest689-21ls22:05:242
8225993411,5cyclictest19101-21diskmemload00:35:052
822499348,14cyclictest7850irq/56-dwc_otg_21:25:331
822499347,7cyclictest23-21ksoftirqd/100:25:171
822499347,14cyclictest7850irq/56-dwc_otg_20:50:311
822499346,5cyclictest7750irq/56-dwc_otg21:15:331
822499341,5cyclictest0-21swapper/100:35:201
78712343,23sleep20-21swapper/219:09:012
822699338,11cyclictest0-21swapper/322:30:123
822699332,6cyclictest7750irq/56-dwc_otg23:45:113
8226993311,5cyclictest0-21swapper/300:30:283
8226993310,4cyclictest0-21swapper/323:00:353
822599335,19cyclictest18871-21ssh00:25:192
822599334,4cyclictest7950irq/56-dwc_otg_23:55:272
8225993322,4cyclictest28476-21basename22:00:192
8225993319,5cyclictest2360350ssh21:15:092
8225993311,7cyclictest9653-21ssh22:15:332
822499335,12cyclictest7950irq/56-dwc_otg_19:35:321
822499334,6cyclictest2888450ssh22:00:251
822499332,5cyclictest0-21swapper/122:05:281
822499332,5cyclictest0-21swapper/122:05:281
8224993319,4cyclictest11380-21sh22:18:381
8224993317,6cyclictest509-21cron19:45:051
822499331,6cyclictest0-21swapper/123:55:191
8224993313,4cyclictest25275-21entropy22:35:231
8224993311,4cyclictest0-21swapper/123:00:301
822499331,12cyclictest7750irq/56-dwc_otg19:15:241
822499331,12cyclictest7750irq/56-dwc_otg19:15:241
74872331,3sleep27635-21ssh21:35:062
822699326,19cyclictest7750irq/56-dwc_otg00:25:293
822699326,13cyclictest7950irq/56-dwc_otg_23:12:393
8226993220,8cyclictest381ktimersoftd/320:50:163
822699321,21cyclictest0-21swapper/321:30:203
822699321,19cyclictest5193-21/usr/sbin/munin22:50:203
822599329,12cyclictest0-21swapper/222:44:302
822599325,16cyclictest7950irq/56-dwc_otg_20:10:202
822599323,6cyclictest14517-21users23:00:352
822599321,6cyclictest12006-21/usr/sbin/munin20:50:242
822499329,4cyclictest0-21swapper/100:32:411
822499323,5cyclictest30404-21sed22:40:331
822499322,9cyclictest0-21swapper/121:50:311
8224993211,4cyclictest0-21swapper/121:35:291
822699318,4cyclictest7950irq/56-dwc_otg_19:50:243
822699313,14cyclictest7950irq/56-dwc_otg_22:47:383
8226993123,6cyclictest31911-21rm22:43:143
8226993121,8cyclictest7950irq/56-dwc_otg_22:10:163
822599319,4cyclictest0-21swapper/222:20:182
822599316,11cyclictest7950irq/56-dwc_otg_19:15:292
822599316,11cyclictest7950irq/56-dwc_otg_19:15:292
822599312,18cyclictest0-21swapper/222:10:202
822599311,14cyclictest24604-21fschecks_count21:55:232
822499319,5cyclictest7750irq/56-dwc_otg19:30:221
822499315,14cyclictest0-21swapper/119:55:281
822499313,3cyclictest0-21swapper/123:52:581
8224993114,4cyclictest26566-21grep20:00:231
8224993114,4cyclictest26566-21grep20:00:231
34572310,2sleep20-21swapper/220:25:252
822699309,4cyclictest0-21swapper/300:00:333
822699304,7cyclictest7950irq/56-dwc_otg_23:25:303
822699304,6cyclictest7750irq/56-dwc_otg19:15:313
822699304,6cyclictest7750irq/56-dwc_otg19:15:313
822699301,3cyclictest0-21swapper/322:00:113
822699301,20cyclictest0-21swapper/319:25:313
822699301,13cyclictest0-21swapper/322:17:053
822699301,10cyclictest7750irq/56-dwc_otg20:40:333
822699301,10cyclictest7750irq/56-dwc_otg20:40:333
822599301,17cyclictest14558-21ls19:25:312
822499304,6cyclictest7750irq/56-dwc_otg00:20:211
822699299,5cyclictest7950irq/56-dwc_otg_22:25:333
822699294,13cyclictest7950irq/56-dwc_otg_21:00:063
822699291,8cyclictest29894-21/usr/sbin/munin20:10:233
822599298,5cyclictest29-21rcuc/219:55:192
822499297,4cyclictest7750irq/56-dwc_otg20:06:181
822499295,11cyclictest7850irq/56-dwc_otg_19:46:181
67212296,11sleep30-21swapper/319:05:223
822699289,10cyclictest0-21swapper/320:45:183
822699284,12cyclictest7950irq/56-dwc_otg_19:55:263
822699283,5cyclictest7750irq/56-dwc_otg20:20:233
822699283,13cyclictest13606-21runrttasks19:25:053
822699282,17cyclictest0-21swapper/320:25:283
822699281,5cyclictest32397-21ntp_states20:15:293
822599281,15cyclictest3501-21ssh23:26:592
822499284,4cyclictest7750irq/56-dwc_otg19:25:171
822699274,12cyclictest7950irq/56-dwc_otg_21:00:103
76152276,14sleep10-21swapper/119:05:491
822699261,15cyclictest0-21swapper/319:40:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional