You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 04:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Sat Jul 04, 2026 00:45:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1971199603,16cyclictest131rcu_preempt21:50:122
1971199573,33cyclictest20441-21ssh00:00:132
1971199573,33cyclictest20441-21ssh00:00:132
1971199552,35cyclictest4236-21ssh21:45:112
1970199491,44cyclictest930-21snmpd23:25:101
1971199465,7cyclictest131rcu_preempt22:00:132
1970199462,34cyclictest592-21ssh21:25:131
1971199431,31cyclictest6033-21ssh21:10:142
1971199431,31cyclictest27-21ksoftirqd/222:30:112
19720994214,16cyclictest0-21swapper/321:40:123
19711994129,5cyclictest27346irq/40-dwc2_hso21:15:122
1971199404,21cyclictest6050-21ssh00:10:122
19711994017,12cyclictest27-21ksoftirqd/221:30:122
1971199391,29cyclictest15092-21ssh22:45:122
1972099385,19cyclictest35966irq/58-eth000:25:143
1971199361,15cyclictest5615-21diskmemload00:15:132
19720993523,6cyclictest0-21swapper/323:25:123
1971199352,24cyclictest16774-21ssh22:10:132
19720993420,12cyclictest0-21swapper/321:50:113
1971199341,24cyclictest7959-21ssh23:35:112
1970199331,25cyclictest11405-21ssh22:25:121
1970099333,9cyclictest12-21ksoftirqd/021:00:130
1972099324,23cyclictest35966irq/58-eth023:50:133
1971199321,21cyclictest24070-21ssh22:50:122
19720993121,7cyclictest0-21swapper/300:10:113
1971199313,19cyclictest19699-21cyclictest21:20:132
1970199315,19cyclictest2525-21ssh23:50:131
19701993119,4cyclictest537-21kworker/u8:221:31:141
19701993115,9cyclictest21-21ksoftirqd/100:10:221
19720993023,3cyclictest0-21swapper/320:40:123
19720993023,3cyclictest0-21swapper/320:40:123
1971199304,18cyclictest27346irq/40-dwc2_hso23:10:132
1971199304,18cyclictest27346irq/40-dwc2_hso23:10:132
19711993020,7cyclictest0-21swapper/223:00:112
19711993017,7cyclictest27-21ksoftirqd/222:15:112
19711993013,12cyclictest27-21ksoftirqd/221:35:132
1971199301,2cyclictest131rcu_preempt00:35:112
1970099304,4cyclictest12-21ksoftirqd/023:30:230
19700993015,8cyclictest19699-21cyclictest19:40:130
19720992924,3cyclictest35966irq/58-eth022:55:103
19720992924,3cyclictest0-21swapper/319:45:123
19720992923,3cyclictest0-21swapper/322:25:123
19720992919,4cyclictest0-21swapper/300:20:123
1971199293,20cyclictest0-21swapper/219:30:112
1971199293,18cyclictest27346irq/40-dwc2_hso20:30:122
1971199292,21cyclictest0-21swapper/222:55:122
1971199292,18cyclictest27346irq/40-dwc2_hso20:45:132
1971199291,19cyclictest27346irq/40-dwc2_hso19:10:132
1971199291,18cyclictest27346irq/40-dwc2_hso22:40:142
1971199291,18cyclictest27346irq/40-dwc2_hso22:40:142
19701992915,7cyclictest21-21ksoftirqd/122:20:241
19701992912,10cyclictest0-21swapper/100:18:081
1970099292,19cyclictest5615-21diskmemload23:05:120
19720992818,4cyclictest0-21swapper/320:45:143
19720992817,8cyclictest0-21swapper/323:05:123
1971199282,20cyclictest0-21swapper/220:50:142
1970199289,4cyclictest21-21ksoftirqd/123:45:051
1970199288,9cyclictest21-21ksoftirqd/119:40:121
1970199288,6cyclictest21-21ksoftirqd/121:47:491
1970199288,10cyclictest21-21ksoftirqd/122:35:171
19701992821,4cyclictest201rcuc/100:20:121
19701992815,7cyclictest29513-21ssh21:58:271
19701992813,4cyclictest21-21ksoftirqd/121:35:141
19701992810,9cyclictest21-21ksoftirqd/122:50:181
19720992722,2cyclictest0-21swapper/319:55:113
1972099272,19cyclictest35966irq/58-eth023:00:093
1972099272,15cyclictest35966irq/58-eth022:30:113
19720992720,2cyclictest0-21swapper/300:35:113
19720992719,5cyclictest0-21swapper/321:20:133
1971199274,7cyclictest23954-21ssh00:20:122
1971199273,16cyclictest27346irq/40-dwc2_hso20:40:152
1971199273,16cyclictest27346irq/40-dwc2_hso20:40:142
1971199273,11cyclictest11418-21ssh23:55:112
1970199279,8cyclictest21-21ksoftirqd/120:25:171
19701992718,3cyclictest21-21ksoftirqd/122:15:021
19701992715,5cyclictest21-21ksoftirqd/121:50:121
19701992714,6cyclictest7815-21sshd20:04:451
19701992714,3cyclictest21-21ksoftirqd/123:32:461
19701992713,4cyclictest21-21ksoftirqd/122:42:331
19701992713,4cyclictest21-21ksoftirqd/122:42:321
19701992712,7cyclictest0-21swapper/123:36:481
19701992710,9cyclictest21-21ksoftirqd/121:20:191
19701992710,8cyclictest21-21ksoftirqd/123:08:061
1970099274,6cyclictest12-21ksoftirqd/023:29:470
1970099274,6cyclictest12-21ksoftirqd/021:30:110
1970099273,4cyclictest12-21ksoftirqd/023:55:270
1970099272,19cyclictest26014-21ssh23:45:140
19720992622,2cyclictest0-21swapper/300:15:123
19720992621,2cyclictest0-21swapper/322:15:123
19720992621,2cyclictest0-21swapper/320:10:123
19720992621,2cyclictest0-21swapper/320:10:123
19720992619,4cyclictest0-21swapper/320:30:113
19720992619,2cyclictest0-21swapper/321:35:123
1971199268,12cyclictest0-21swapper/219:45:122
1971199265,12cyclictest27346irq/40-dwc2_hso20:35:112
19711992615,9cyclictest29464-21sh22:35:122
1971199261,11cyclictest19030-21cut23:05:162
1970199267,9cyclictest21-21ksoftirqd/123:40:161
1970199267,10cyclictest0-21swapper/123:58:361
1970199266,8cyclictest9291-21cron23:00:011
1970199266,10cyclictest21-21ksoftirqd/119:50:011
1970199264,5cyclictest21-21ksoftirqd/123:19:361
1970199264,5cyclictest21-21ksoftirqd/123:19:351
19701992617,4cyclictest17625-21ssh23:04:051
19701992611,7cyclictest0-21swapper/121:43:191
19701992611,4cyclictest21-21ksoftirqd/122:31:441
1970099268,3cyclictest131rcu_preempt21:57:140
1970099263,6cyclictest12-21ksoftirqd/023:51:010
1970099262,6cyclictest12-21ksoftirqd/022:30:300
1970099262,5cyclictest12-21ksoftirqd/022:20:240
1970099262,4cyclictest12-21ksoftirqd/023:40:190
1970099261,7cyclictest32736-21latency_hist00:25:020
19700992613,3cyclictest0-21swapper/023:21:140
19700992612,7cyclictest0-21swapper/023:35:450
1970099261,10cyclictest12-21ksoftirqd/019:55:110
19720992519,3cyclictest0-21swapper/320:55:143
19720992519,3cyclictest0-21swapper/320:55:133
19720992519,2cyclictest0-21swapper/323:55:113
19720992516,4cyclictest0-21swapper/322:00:123
19720992515,7cyclictest0-21swapper/323:45:313
1971199253,14cyclictest27346irq/40-dwc2_hso22:20:112
1971199253,14cyclictest27346irq/40-dwc2_hso19:35:132
19711992513,9cyclictest0-21swapper/223:20:122
1971199251,10cyclictest15401-21timerwakeupswit22:25:282
1970199259,8cyclictest21-21ksoftirqd/123:12:301
1970199259,8cyclictest21-21ksoftirqd/123:12:291
1970199259,5cyclictest21-21ksoftirqd/121:10:011
1970199257,8cyclictest21-21ksoftirqd/119:35:191
1970199257,8cyclictest21-21ksoftirqd/100:33:431
1970199257,3cyclictest131rcu_preempt20:45:011
1970199257,3cyclictest131rcu_preempt20:45:011
1970199256,9cyclictest21-21ksoftirqd/120:20:181
1970199256,10cyclictest21-21ksoftirqd/120:10:301
1970199256,10cyclictest21-21ksoftirqd/120:10:301
1970199254,12cyclictest21-21ksoftirqd/122:05:211
1970199252,6cyclictest21-21ksoftirqd/100:28:371
1970199251,4cyclictest21-21ksoftirqd/119:25:111
19701992513,4cyclictest21-21ksoftirqd/120:15:211
19701992512,7cyclictest0-21swapper/122:00:481
19701992512,7cyclictest0-21swapper/100:09:141
19701992512,6cyclictest0-21swapper/122:16:241
1970099259,7cyclictest12-21ksoftirqd/022:27:010
1970099259,7cyclictest0-21swapper/021:46:140
1970099258,7cyclictest0-21swapper/000:01:030
1970099258,7cyclictest0-21swapper/000:01:030
1970099258,6cyclictest12-21ksoftirqd/022:03:200
1970099256,9cyclictest0-21swapper/020:05:110
1970099256,2cyclictest131rcu_preempt22:19:120
1970099255,6cyclictest12-21ksoftirqd/023:00:130
1970099254,5cyclictest12-21ksoftirqd/022:45:250
1970099253,5cyclictest12-21ksoftirqd/021:43:200
1970099253,5cyclictest12-21ksoftirqd/019:54:450
1970099253,4cyclictest12-21ksoftirqd/020:10:260
1970099253,4cyclictest12-21ksoftirqd/020:10:260
1970099252,9cyclictest12-21ksoftirqd/022:50:200
1970099251,8cyclictest12-21ksoftirqd/000:10:140
1970099251,19cyclictest29564-21apt-get19:20:120
19700992511,7cyclictest0-21swapper/021:12:250
1970099250,7cyclictest18761-21latency_hist20:50:010
1972099243,16cyclictest0-21swapper/323:30:113
19720992420,2cyclictest0-21swapper/320:50:123
19720992419,2cyclictest0-21swapper/321:25:113
19720992419,2cyclictest0-21swapper/321:15:133
19720992419,2cyclictest0-21swapper/300:05:123
19720992418,3cyclictest0-21swapper/321:45:123
19720992418,3cyclictest0-21swapper/320:20:113
19720992417,4cyclictest0-21swapper/321:30:123
19720992416,5cyclictest0-21swapper/322:20:113
19720992413,7cyclictest0-21swapper/321:10:143
1971199242,8cyclictest29448-21ssh00:05:122
1971199242,16cyclictest0-21swapper/220:10:062
1971199242,16cyclictest0-21swapper/220:10:052
1971199241,14cyclictest930-21snmpd23:40:132
1971199241,14cyclictest449-21ssh00:25:122
1971199240,9cyclictest31605-21cut23:30:162
1970199247,9cyclictest21-21ksoftirqd/100:00:211
1970199247,9cyclictest21-21ksoftirqd/100:00:211
1970199246,9cyclictest21-21ksoftirqd/120:30:271
1970199245,8cyclictest21-21ksoftirqd/122:45:181
1970199245,10cyclictest21-21ksoftirqd/119:20:021
1970199244,3cyclictest131rcu_preempt21:15:111
1970199243,3cyclictest131rcu_preempt00:35:111
19701992411,6cyclictest0-21swapper/121:13:571
19701992411,4cyclictest21-21ksoftirqd/123:22:421
19701992411,4cyclictest21-21ksoftirqd/121:00:291
1970099247,5cyclictest12-21ksoftirqd/022:14:320
1970099246,8cyclictest131rcu_preempt21:20:230
1970099246,3cyclictest131rcu_preempt00:18:060
1970099245,5cyclictest12-21ksoftirqd/021:25:180
1970099245,3cyclictest131rcu_preempt22:35:250
1970099245,3cyclictest131rcu_preempt21:15:190
1970099245,3cyclictest131rcu_preempt00:35:110
1970099244,5cyclictest12-21ksoftirqd/020:00:190
1970099244,4cyclictest12-21ksoftirqd/019:25:200
1970099243,9cyclictest12-21ksoftirqd/000:30:300
1970099243,7cyclictest131rcu_preempt20:40:010
1970099243,6cyclictest12-21ksoftirqd/022:40:300
1970099243,6cyclictest12-21ksoftirqd/022:40:290
1970099243,6cyclictest12-21ksoftirqd/021:50:110
1970099243,5cyclictest12-21ksoftirqd/020:25:310
1970099243,3cyclictest131rcu_preempt23:10:040
1970099243,3cyclictest131rcu_preempt23:10:040
19700992415,3cyclictest23844-21apt-get20:55:130
19700992415,3cyclictest23844-21apt-get20:55:130
19700992413,6cyclictest9405-21apt-get20:40:130
19700992413,6cyclictest9405-21apt-get20:40:130
19720992318,3cyclictest0-21swapper/322:35:123
19720992318,3cyclictest0-21swapper/322:10:133
19720992317,3cyclictest0-21swapper/323:15:133
19720992317,3cyclictest0-21swapper/323:15:133
1972099231,12cyclictest0-21swapper/323:20:133
1971199236,14cyclictest26724-21cat23:25:292
1971199234,15cyclictest3000-21cron20:00:012
1971199233,12cyclictest27346irq/40-dwc2_hso23:15:142
1971199233,12cyclictest27346irq/40-dwc2_hso23:15:142
1971199232,6cyclictest0-21swapper/221:55:152
19711992312,9cyclictest32631-21ssh23:47:422
19711992311,9cyclictest27-21ksoftirqd/220:55:132
19711992311,9cyclictest27-21ksoftirqd/220:55:132
1970199239,8cyclictest0-21swapper/119:10:021
1970199238,8cyclictest21-21ksoftirqd/119:55:191
1970199237,5cyclictest21-21ksoftirqd/120:55:171
1970199237,5cyclictest21-21ksoftirqd/120:55:171
1970199236,9cyclictest21-21ksoftirqd/120:35:211
1970199236,8cyclictest21-21ksoftirqd/119:20:181
1970199232,14cyclictest21-21ksoftirqd/119:50:131
19701992311,4cyclictest21-21ksoftirqd/120:45:291
1970199231,11cyclictest21-21ksoftirqd/119:30:141
1970099236,3cyclictest131rcu_preempt23:15:290
1970099236,3cyclictest131rcu_preempt23:15:290
1970099235,6cyclictest12-21ksoftirqd/020:15:140
1970099235,5cyclictest12-21ksoftirqd/019:15:290
1970099234,4cyclictest12-21ksoftirqd/019:30:270
1970099233,7cyclictest12-21ksoftirqd/021:35:120
1970099233,6cyclictest12-21ksoftirqd/022:55:060
1970099233,5cyclictest12-21ksoftirqd/000:25:160
1970099233,11cyclictest12-21ksoftirqd/000:05:270
19700992316,4cyclictest0-21swapper/019:10:130
1970099231,4cyclictest12-21ksoftirqd/022:05:190
1972099223,14cyclictest35966irq/58-eth022:45:113
19720992217,3cyclictest0-21swapper/319:40:123
19720992217,2cyclictest0-21swapper/321:55:143
19720992217,2cyclictest0-21swapper/320:00:113
19720992217,2cyclictest0-21swapper/300:30:103
19720992213,7cyclictest0-21swapper/322:40:243
19720992213,7cyclictest0-21swapper/322:40:243
19720992213,6cyclictest0-21swapper/321:05:333
19720992213,6cyclictest0-21swapper/320:15:163
19720992213,6cyclictest0-21swapper/319:36:453
19720992213,6cyclictest0-21swapper/319:30:243
19720992213,6cyclictest0-21swapper/319:10:273
19720992212,7cyclictest0-21swapper/319:20:243
19720992211,8cyclictest0-21swapper/323:10:183
19720992211,8cyclictest0-21swapper/323:10:183
1971199227,12cyclictest3126-21irqrtprio23:50:182
1971199222,13cyclictest8497-21uname22:05:182
1971199221,8cyclictest135-21systemd-journal19:45:012
1971199221,17cyclictest1371-21kthreadcore21:25:212
1970199225,8cyclictest21-21ksoftirqd/120:05:171
19701992213,6cyclictest0-21swapper/120:50:191
1970099226,3cyclictest131rcu_preempt20:20:280
1970099224,7cyclictest12-21ksoftirqd/019:35:190
1970099224,3cyclictest131rcu_preempt21:05:200
1970099223,6cyclictest12-21ksoftirqd/020:30:260
1970099222,5cyclictest12-21ksoftirqd/019:45:140
19720992117,2cyclictest0-21swapper/323:40:123
19720992117,2cyclictest0-21swapper/322:05:113
19720992117,2cyclictest0-21swapper/319:50:113
19720992116,3cyclictest0-21swapper/322:50:133
19720992116,2cyclictest0-21swapper/320:35:113
19720992113,6cyclictest0-21swapper/300:00:223
19720992113,6cyclictest0-21swapper/300:00:223
19720992112,6cyclictest0-21swapper/319:25:123
19720992111,7cyclictest0-21swapper/323:39:073
19720992111,7cyclictest0-21swapper/319:15:283
1971199213,9cyclictest28507-21kthreadcore21:40:202
1971199213,15cyclictest22737-21fschecks_count20:20:152
1971199211,5cyclictest0-21swapper/219:15:122
1971199211,10cyclictest32222-21wc21:00:262
1970099211,8cyclictest12-21ksoftirqd/020:50:130
19720992016,2cyclictest0-21swapper/321:00:153
19720992014,3cyclictest0-21swapper/320:05:113
19720992011,7cyclictest0-21swapper/320:25:193
1971199207,6cyclictest29537-21ntp_states19:50:252
1971199201,9cyclictest31216-21tail20:25:282
1971199201,15cyclictest2175-21fschecks_time19:25:152
1971199201,11cyclictest9724-21grep00:30:152
1971199201,11cyclictest6755-21wc20:00:262
1971199201,11cyclictest11565-21ps20:05:252
1971199201,10cyclictest18158-21irqcore20:15:172
1971199191,4cyclictest0-21swapper/219:20:122
1971199191,10cyclictest2075-21kthreadcore21:05:212
1970199194,5cyclictest21-21ksoftirqd/119:10:011
19720991813,3cyclictest0-21swapper/319:10:013
1970099183,4cyclictest12-21ksoftirqd/019:10:010
1971199152,10cyclictest19715-21latency_hist19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional