You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 12:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8s.osadl.org (updated Thu Jun 25, 2026 00:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
147052180105,29sleep20-21swapper/219:08:572
145942180107,28sleep00-21swapper/019:07:310
1400421680,1sleep00-21swapper/000:07:460
146242161105,29sleep30-21swapper/319:07:543
146372160104,28sleep10-21swapper/119:08:041
75812640,3sleep3331rcuc/323:15:013
17682610,3sleep11767-21users22:45:251
140612590,1sleep10-21swapper/121:18:561
88622550,1sleep10-21swapper/121:39:111
97412540,1sleep00-21swapper/023:15:370
77132530,2sleep10-21swapper/123:15:061
50692520,2sleep10-21swapper/123:36:331
142432510,2sleep20-21swapper/221:42:492
323912500,9sleep228-21ksoftirqd/223:57:102
323912500,9sleep228-21ksoftirqd/223:57:092
244932500,3sleep20-21swapper/222:15:082
144932500,1sleep00-21swapper/022:30:470
313942490,1sleep20-21swapper/219:45:242
28832480,2sleep20-21swapper/221:58:502
240172480,1sleep20-21swapper/221:25:282
180682460,2sleep20-21swapper/223:46:102
179132460,1sleep30-21swapper/322:58:113
178322410,1sleep00-21swapper/019:15:160
113112380,2sleep20-21swapper/222:53:162
166622350,2chrt0-21swapper/321:20:193
134322350,3sleep00-21swapper/022:55:110
1506399340,7cyclictest16967-21sh20:30:003
299182330,2sleep00-21swapper/023:06:470
1506299321,6cyclictest9045-21ssh23:15:222
15063993127,2cyclictest0-21swapper/323:16:293
15063993122,3cyclictest12318-21ssh00:06:053
221442300,1sleep00-21swapper/023:00:420
15063993021,3cyclictest26076-21ssh21:27:333
1506299301,18cyclictest28-21ksoftirqd/223:30:112
15063992920,3cyclictest5319-21ssh21:35:343
1506399287,5cyclictest34-21ksoftirqd/300:00:003
1506399287,5cyclictest34-21ksoftirqd/300:00:003
1506399286,12cyclictest34-21ksoftirqd/321:11:333
15063992819,3cyclictest2751-21ssh21:34:443
15063992819,3cyclictest25485-21ssh21:50:413
15063992811,2cyclictest141rcu_preempt00:34:203
15063992810,4cyclictest34-21ksoftirqd/322:40:103
15062992812,4cyclictest28-21ksoftirqd/200:21:502
1506199281,25cyclictest0-21swapper/119:42:051
1506199281,25cyclictest0-21swapper/119:35:291
15060992817,9cyclictest2844-40mandb00:00:000
15060992817,9cyclictest2844-40mandb00:00:000
1506099281,25cyclictest0-21swapper/019:36:570
205612270,1sleep20-21swapper/221:47:272
204052270,2sleep20-21swapper/222:35:222
1506399275,9cyclictest34-21ksoftirqd/323:03:403
15063992721,4cyclictest34-21ksoftirqd/320:20:003
1506399272,12cyclictest0-21swapper/300:38:593
15063992719,3cyclictest12969-21ssh21:17:493
15063992719,2cyclictest1080-21ssh00:22:033
15063992718,3cyclictest6612-21ssh22:00:493
15063992716,10cyclictest34-21ksoftirqd/320:25:003
15063992712,2cyclictest141rcu_preempt00:02:493
1506299279,3cyclictest141rcu_preempt00:26:342
1506299271,24cyclictest0-21swapper/219:36:232
1506199279,4cyclictest141rcu_preempt00:30:121
15061992724,2cyclictest0-21swapper/119:24:271
1506199270,5cyclictest0-21swapper/122:10:011
1506099271,24cyclictest0-21swapper/019:29:010
191382260,1sleep10-21swapper/122:59:251
1506399269,4cyclictest34-21ksoftirqd/321:43:513
1506399269,2cyclictest141rcu_preempt00:15:183
1506399268,4cyclictest34-21ksoftirqd/300:29:243
1506399266,9cyclictest34-21ksoftirqd/322:34:203
1506399262,11cyclictest0-21swapper/320:13:133
15063992613,2cyclictest141rcu_preempt22:10:153
1506399261,23cyclictest0-21swapper/319:35:483
1506399261,23cyclictest0-21swapper/319:32:463
15063992612,2cyclictest141rcu_preempt22:52:033
15063992611,5cyclictest34-21ksoftirqd/320:55:003
15063992610,4cyclictest34-21ksoftirqd/322:25:193
1506299269,3cyclictest141rcu_preempt23:09:462
1506299269,3cyclictest141rcu_preempt22:49:212
1506299268,5cyclictest141rcu_preempt21:54:202
1506299268,4cyclictest28-21ksoftirqd/222:00:492
1506299265,10cyclictest28-21ksoftirqd/222:05:122
15062992622,2cyclictest0-21swapper/219:29:202
1506299261,2cyclictest0-21swapper/219:32:592
15062992612,4cyclictest28-21ksoftirqd/221:21:322
15062992611,4cyclictest28-21ksoftirqd/222:59:562
15062992610,7cyclictest141rcu_preempt22:27:122
15062992610,5cyclictest28-21ksoftirqd/200:12:072
15061992623,2cyclictest0-21swapper/119:30:401
15061992618,6cyclictest32392-21sh23:57:101
15061992618,6cyclictest32392-21sh23:57:091
1506099261,1cyclictest0-21swapper/019:24:270
1506099260,19cyclictest0-21swapper/019:42:050
1506399255,10cyclictest34-21ksoftirqd/323:44:363
1506399255,10cyclictest34-21ksoftirqd/322:39:273
1506399253,2cyclictest141rcu_preempt19:50:003
1506399251,23cyclictest0-21swapper/319:26:333
1506399250,23cyclictest25520-21ssh23:51:573
1506299259,6cyclictest28-21ksoftirqd/223:28:442
1506299259,4cyclictest28-21ksoftirqd/223:51:192
1506299259,3cyclictest141rcu_preempt20:55:192
1506299259,2cyclictest141rcu_preempt21:30:102
1506299258,7cyclictest141rcu_preempt21:38:332
1506299258,5cyclictest28-21ksoftirqd/200:35:452
1506299258,4cyclictest28-21ksoftirqd/223:37:232
1506299258,3cyclictest141rcu_preempt22:31:362
1506299258,3cyclictest141rcu_preempt00:34:042
15062992511,4cyclictest28-21ksoftirqd/222:23:282
1506299251,12cyclictest28-21ksoftirqd/223:43:152
15062992510,4cyclictest28-21ksoftirqd/221:13:002
15062992510,2cyclictest141rcu_preempt22:13:592
1506299250,19cyclictest28-21ksoftirqd/220:05:242
1506199256,6cyclictest22-21ksoftirqd/121:45:221
15061992523,1cyclictest0-21swapper/119:27:041
15060992515,6cyclictest21509-21apt-get20:40:120
1506099250,1cyclictest0-21swapper/019:31:020
57722240,4sleep228-21ksoftirqd/223:13:232
254142240,3sleep122-21ksoftirqd/122:15:201
15063992422,1cyclictest0-21swapper/319:24:383
15063992416,2cyclictest7795-21ssh23:39:183
15063992411,2cyclictest141rcu_preempt22:47:123
15063992410,3cyclictest141rcu_preempt21:47:203
15063992410,2cyclictest141rcu_preempt22:20:263
1506299249,7cyclictest141rcu_preempt20:18:522
1506299249,4cyclictest28-21ksoftirqd/221:17:142
1506299248,5cyclictest28-21ksoftirqd/223:24:442
1506299248,5cyclictest28-21ksoftirqd/200:07:352
1506299248,2cyclictest141rcu_preempt22:40:102
1506299246,2cyclictest141rcu_preempt23:00:352
15062992422,1cyclictest0-21swapper/219:24:382
1506299241,1cyclictest0-21swapper/219:42:052
15061992422,1cyclictest0-21swapper/119:52:071
1506099244,4cyclictest12-21ksoftirqd/022:19:590
15060992419,3cyclictest5932-21timerandwakeup00:25:240
15060992414,7cyclictest26131-21df_inode22:40:130
262512230,1sleep10-21swapper/121:51:271
1506399239,4cyclictest34-21ksoftirqd/323:20:173
1506399238,4cyclictest34-21ksoftirqd/300:11:473
1506399237,7cyclictest34-21ksoftirqd/320:00:143
1506399234,9cyclictest34-21ksoftirqd/322:17:273
15063992313,7cyclictest21973-21fw_packets20:40:163
1506299231,12cyclictest28-21ksoftirqd/200:18:372
1506199231,10cyclictest133892fschecks_time20:20:161
15060992320,2cyclictest0-21swapper/019:52:070
1506099231,8cyclictest6211-21fschecks_time22:25:150
145842230,1sleep30-21swapper/322:07:063
14582230,2chrt0-21swapper/123:10:131
89642220,2sleep00-21swapper/021:15:140
306102220,1sleep30-21swapper/323:31:263
1506399226,5cyclictest34-21ksoftirqd/323:25:023
1506399225,5cyclictest34-21ksoftirqd/323:05:193
15063992220,1cyclictest0-21swapper/319:42:053
15063992216,4cyclictest34-21ksoftirqd/320:40:003
15063992214,6cyclictest30582-21diskstats21:55:163
1506299228,4cyclictest28-21ksoftirqd/219:11:072
1506299228,3cyclictest141rcu_preempt20:25:202
1506299227,3cyclictest141rcu_preempt20:51:132
15062992217,3cyclictest271rcuc/220:40:002
15062992216,4cyclictest28-21ksoftirqd/220:45:002
15062992210,4cyclictest28-21ksoftirqd/200:00:422
1506199224,2cyclictest1700-21diskmemload22:04:591
1506199223,3cyclictest1700-21diskmemload23:47:411
1506199223,3cyclictest1700-21diskmemload21:24:181
15061992220,1cyclictest0-21swapper/120:19:231
1506199221,5cyclictest0-21swapper/123:44:081
15061992214,4cyclictest3301-21sh00:00:131
15061992213,7cyclictest560-21dbus-daemon20:40:001
15061992213,5cyclictest17913-21sh22:10:121
15061992211,7cyclictest52850irq/140-enp3s0-22:50:131
15060992216,4cyclictest20774-21sh23:25:000
15060992212,7cyclictest23359-21cut21:25:200
1506399215,7cyclictest34-21ksoftirqd/323:47:533
15063992113,6cyclictest18368-21python320:30:233
15062992112,7cyclictest32681-21ls19:50:132
1506199213,4cyclictest1700-21diskmemload00:15:151
1506199213,3cyclictest1700-21diskmemload23:09:521
1506199213,3cyclictest1700-21diskmemload23:00:481
1506199213,3cyclictest1700-21diskmemload22:44:471
1506199213,3cyclictest141rcu_preempt22:37:141
1506199212,3cyclictest1700-21diskmemload22:29:241
1506199211,5cyclictest0-21swapper/123:34:011
15061992113,6cyclictest31571-21awk21:00:241
15061992113,6cyclictest16846-21cat00:10:131
15061992112,7cyclictest21334-21cut23:25:121
15061992112,6cyclictest22425-21tr23:50:131
15061992110,3cyclictest22-21ksoftirqd/100:25:101
15060992115,3cyclictest1700-21diskmemload22:03:240
15060992113,6cyclictest9783-21python320:10:230
15060992113,6cyclictest24229-21idleruntime20:45:170
15060992112,6cyclictest14984-21cat20:25:010
179162200,3chrt0-21swapper/119:15:171
1506399205,7cyclictest34-21ksoftirqd/321:05:223
1506399205,7cyclictest34-21ksoftirqd/320:05:193
1506399201,7cyclictest34-21ksoftirqd/321:00:163
15063992014,4cyclictest34-21ksoftirqd/321:00:003
15063992013,5cyclictest3346-21sensors19:55:223
1506299207,2cyclictest141rcu_preempt21:08:342
1506299201,9cyclictest28-21ksoftirqd/220:45:232
1506299201,5cyclictest28-21ksoftirqd/220:00:142
1506199209,8cyclictest15670-21processes23:20:201
1506199203,3cyclictest1700-21diskmemload21:33:021
1506199201,5cyclictest0-21swapper/122:30:091
1506199201,5cyclictest0-21swapper/121:26:371
1506199201,5cyclictest0-21swapper/100:37:581
1506199201,4cyclictest10135-21apt-get21:40:121
15061992012,6cyclictest2653-21fw_packets19:55:151
15061992012,6cyclictest24348-21sed20:45:181
1506199200,5cyclictest0-21swapper/122:21:191
1506099204,3cyclictest141rcu_preempt21:45:150
1506099203,5cyclictest12-21ksoftirqd/000:19:060
1506099203,3cyclictest141rcu_preempt23:34:500
1506099202,3cyclictest141rcu_preempt23:52:510
15060992017,2cyclictest0-21swapper/020:19:230
1506099201,5cyclictest0-21swapper/021:50:110
1506099201,4cyclictest16689-21ntp_states23:45:210
15060992014,4cyclictest29046-21sendmail_mailtr20:55:200
15060992012,6cyclictest31956-21if_enp3s022:20:170
15060992012,6cyclictest1624-21fw_packets23:10:150
15060992012,6cyclictest15154-21awk19:10:120
15060992011,6cyclictest32467-21apt-get22:45:100
15060992011,6cyclictest31074-21pmu-power19:45:210
15060992010,6cyclictest52750irq/139-enp3s0-00:35:120
109772200,3sleep10-21swapper/100:05:201
1506399195,7cyclictest34-21ksoftirqd/319:10:183
1506399194,4cyclictest34-21ksoftirqd/319:54:413
15063991910,7cyclictest23979-21df_inode20:45:153
1506299197,3cyclictest141rcu_preempt21:00:182
1506299197,3cyclictest141rcu_preempt19:15:192
1506299193,2cyclictest141rcu_preempt20:10:332
1506299191,6cyclictest28-21ksoftirqd/220:20:172
15061991914,3cyclictest8982-21sort20:10:151
15061991912,5cyclictest5361-21seq21:11:571
15061991912,5cyclictest31499-21tr21:55:241
15061991911,6cyclictest22-21ksoftirqd/119:50:001
15061991911,6cyclictest18151-21awk20:30:211
1506099195,2cyclictest141rcu_preempt23:36:280
1506099193,3cyclictest1700-21diskmemload00:24:400
1506099192,3cyclictest141rcu_preempt21:40:310
15060991914,3cyclictest636-21runrttasks23:40:110
15060991914,3cyclictest1700-21diskmemload23:27:580
15060991914,3cyclictest1700-21diskmemload00:11:110
15060991913,4cyclictest636-21runrttasks00:02:180
15060991913,4cyclictest14063-21sh22:06:340
15060991912,5cyclictest1702-21ls21:10:000
15060991912,4cyclictest1700-21diskmemload21:58:150
15060991912,4cyclictest1700-21diskmemload21:32:450
15060991912,4cyclictest13076-21unixbench_singl00:30:250
15060991911,6cyclictest8230-21cat22:50:260
15060991911,6cyclictest7164-21cut20:05:160
15060991911,6cyclictest18307-21awk22:10:150
15060991911,5cyclictest19322-21seq20:35:100
1506099190,3cyclictest141rcu_preempt21:35:200
1506399181,8cyclictest179212kernelversion19:15:173
1506299188,2cyclictest141rcu_preempt19:57:082
1506299180,5cyclictest0-21swapper/220:30:182
15061991811,5cyclictest22931-21grep20:40:251
15061991811,5cyclictest1046-21wc21:05:231
1506099189,6cyclictest26208-21tune2fs20:50:150
1506099182,3cyclictest1700-21diskmemload21:20:030
15060991813,3cyclictest3361-21switchtime19:55:230
15060991812,4cyclictest19415-21sh22:35:130
15060991812,3cyclictest2204-21cpuspeed_turbos21:10:130
15060991811,5cyclictest5750-21grep20:00:240
15060991811,5cyclictest31369-21cat21:00:230
1506199179,6cyclictest4778-21cut20:00:151
1506199179,6cyclictest17164-21wc19:15:001
1506199176,9cyclictest560-21dbus-daemon21:00:001
1506199171,5cyclictest0-21swapper/100:20:191
15061991710,5cyclictest6842-21cut20:05:141
15060991710,5cyclictest17832-21cat20:30:170
15061991611,3cyclictest26194-21fschecks_time20:50:151
15061991611,3cyclictest15145-21cpuspeed_turbos20:25:111
1506099152,8cyclictest15070-21apt-get20:25:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional