You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 23:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8s.osadl.org (updated Wed Jun 17, 2026 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2484222099,96sleep00-21swapper/007:05:320
282821710,1sleep10-21swapper/112:07:181
26642162110,29sleep10-21swapper/107:07:541
27242161105,28sleep20-21swapper/207:08:402
25542160109,29sleep30-21swapper/307:06:273
224442660,4sleep0121ksoftirqd/011:57:570
30812650,2sleep30-21swapper/309:19:453
164092610,2sleep30-21swapper/311:29:473
308912600,2sleep30-21swapper/310:04:203
187542580,2sleep20-21swapper/211:06:592
43312520,2sleep00-21swapper/012:32:420
89182510,1sleep10-21swapper/107:20:261
71512510,2sleep20-21swapper/210:10:162
38412510,2sleep10-21swapper/107:10:191
41632500,1sleep20-21swapper/212:32:312
39622500,2sleep10-21swapper/111:20:151
114882500,2sleep122-21ksoftirqd/112:38:081
201902470,3sleep228-21ksoftirqd/209:31:392
87672460,1sleep30-21swapper/311:24:023
55162460,2chrt0-21swapper/110:09:391
38012460,1sleep20-21swapper/210:07:562
3172460,1sleep10-21swapper/109:40:501
272212440,2chrt0-21swapper/009:13:110
177482430,2chrt0-21swapper/207:40:252
142132390,2chrt0-21swapper/109:27:251
232242370,2sleep00-21swapper/010:46:070
310099341,30cyclictest16815-21ssh11:05:231
3102993218,12cyclictest34-21ksoftirqd/308:00:003
309999321,28cyclictest4588-21ssh11:45:010
132422320,2chrt0-21swapper/309:26:273
310299312,18cyclictest30622-21ssh09:40:103
3102993121,2cyclictest141rcu_preempt11:05:123
310299311,7cyclictest11785-21ssh12:38:263
3101993122,7cyclictest29812-21diskstats09:15:122
310099311,27cyclictest23072-21ssh11:34:451
309999311,28cyclictest32100-21ssh11:16:410
309999311,28cyclictest26434-21sh11:12:570
310299301,26cyclictest8769-21ssh12:11:303
310299301,26cyclictest23631-21ssh10:46:323
310099301,2cyclictest0-21swapper/112:11:301
310299291,23cyclictest22079-21ssh11:10:053
310099291,26cyclictest0-21swapper/107:30:141
310099290,26cyclictest22023-21processes10:45:221
309999291,3cyclictest15842-21df11:05:140
310299286,11cyclictest34-21ksoftirqd/310:20:133
3102992822,4cyclictest0-21swapper/311:39:123
310199281,3cyclictest22383-21cat10:45:242
310099281,2cyclictest0-21swapper/111:45:581
310099281,24cyclictest0-21swapper/111:12:121
3099992824,2cyclictest171772chrt09:54:020
3099992824,2cyclictest0-21swapper/012:24:440
309999281,25cyclictest0-21swapper/007:25:520
309999281,25cyclictest0-21swapper/007:25:520
309999281,25cyclictest0-21swapper/007:24:180
310299279,4cyclictest34-21ksoftirqd/310:18:033
310299275,13cyclictest34-21ksoftirqd/309:52:033
3102992723,2cyclictest0-21swapper/312:16:113
310299271,24cyclictest0-21swapper/307:30:263
310199275,11cyclictest0-21swapper/209:45:192
3101992723,2cyclictest4439-21smartctl09:20:162
310199271,24cyclictest22823-21ssh11:34:292
310199271,24cyclictest0-21swapper/212:23:562
310199271,24cyclictest0-21swapper/211:13:442
310199271,24cyclictest0-21swapper/207:20:252
3100992724,2cyclictest0-21swapper/107:28:161
3100992724,2cyclictest0-21swapper/107:28:151
310099271,2cyclictest0-21swapper/112:27:281
310099271,2cyclictest0-21swapper/109:54:221
310099271,24cyclictest0-21swapper/112:23:581
310099271,24cyclictest0-21swapper/107:37:211
309999271,2cyclictest0-21swapper/012:13:560
309999271,2cyclictest0-21swapper/009:18:080
309999271,25cyclictest0-21swapper/012:09:270
309999271,25cyclictest0-21swapper/011:43:380
309999271,24cyclictest0-21swapper/009:20:180
309999271,24cyclictest0-21swapper/007:30:250
310299268,5cyclictest34-21ksoftirqd/310:41:253
310299267,5cyclictest34-21ksoftirqd/310:50:213
310299267,3cyclictest141rcu_preempt10:08:563
3102992622,2cyclictest2814-21ssh11:43:293
310299261,23cyclictest0-21swapper/311:17:263
310299261,23cyclictest0-21swapper/307:26:063
310299261,23cyclictest0-21swapper/307:26:063
310299261,23cyclictest0-21swapper/307:24:083
310299261,18cyclictest0-21swapper/311:45:583
3102992610,3cyclictest141rcu_preempt09:49:043
3101992623,2cyclictest0-21swapper/212:15:362
3101992622,2cyclictest22305-21diskmemload11:43:372
310199261,23cyclictest0-21swapper/212:27:272
310199261,23cyclictest0-21swapper/209:53:582
310199261,23cyclictest0-21swapper/207:31:012
310199261,18cyclictest0-21swapper/211:16:062
310199260,3cyclictest8818-21ssh12:11:352
310199260,23cyclictest0-21swapper/207:26:042
310199260,23cyclictest0-21swapper/207:26:032
3100992624,1cyclictest0-21swapper/111:39:301
3100992623,2cyclictest22305-21diskmemload11:42:491
3100992623,2cyclictest0-21swapper/112:16:131
3100992623,2cyclictest0-21swapper/107:52:211
3100992622,2cyclictest0-21swapper/109:18:081
310099261,24cyclictest0-21swapper/107:19:351
310099261,1cyclictest0-21swapper/111:16:051
3099992624,1cyclictest0-21swapper/012:38:370
309999261,24cyclictest0-21swapper/011:39:010
309999261,24cyclictest0-21swapper/011:34:190
309999261,23cyclictest0-21swapper/010:20:260
309999261,1cyclictest0-21swapper/012:25:040
309999261,1cyclictest0-21swapper/012:15:260
309999260,24cyclictest0-21swapper/007:39:520
310299258,5cyclictest34-21ksoftirqd/311:50:043
310299255,10cyclictest34-21ksoftirqd/309:23:443
310299253,11cyclictest34-21ksoftirqd/311:02:223
3102992512,4cyclictest34-21ksoftirqd/310:30:253
310299251,23cyclictest0-21swapper/312:23:553
310299251,23cyclictest0-21swapper/311:34:573
310299251,1cyclictest0-21swapper/312:09:473
310299251,1cyclictest0-21swapper/307:37:183
310299250,23cyclictest0-21swapper/312:26:393
310299250,23cyclictest0-21swapper/307:19:353
310299250,10cyclictest34-21ksoftirqd/311:55:203
3101992523,1cyclictest0-21swapper/211:39:232
3101992521,2cyclictest22305-21diskmemload12:39:222
3101992516,7cyclictest4685-21ssh12:09:102
310199251,2cyclictest0-21swapper/211:45:592
310199251,1cyclictest0-21swapper/207:52:362
310199251,1cyclictest0-21swapper/207:37:172
309999251,1cyclictest0-21swapper/009:27:250
118032250,2sleep20-21swapper/211:50:132
310299249,4cyclictest34-21ksoftirqd/312:01:013
310299245,6cyclictest34-21ksoftirqd/309:14:363
310299245,10cyclictest34-21ksoftirqd/308:35:183
310299241,19cyclictest22305-21diskmemload09:37:263
310299240,12cyclictest34-21ksoftirqd/310:14:533
310299240,10cyclictest34-21ksoftirqd/309:57:013
310199249,3cyclictest218572rm09:57:002
310099243,3cyclictest22305-21diskmemload11:00:491
3100992420,2cyclictest0-21swapper/109:22:021
309999240,23cyclictest0-21swapper/007:52:200
309999240,1cyclictest0-21swapper/011:52:200
218552240,2sleep10-21swapper/109:56:591
97722230,8sleep012-21ksoftirqd/009:48:190
310299237,4cyclictest34-21ksoftirqd/309:31:593
310299235,6cyclictest34-21ksoftirqd/310:36:503
3102992321,1cyclictest0-21swapper/307:52:333
3101992316,5cyclictest32528-21ssh10:29:522
3101992313,7cyclictest2516-21fw_packets10:55:132
310099233,17cyclictest10050-21tune2fs08:40:151
3100992315,6cyclictest11917-21ls11:25:231
3099992321,1cyclictest0-21swapper/007:19:490
3099992312,9cyclictest31795-21processes09:40:190
310299226,10cyclictest34-21ksoftirqd/312:32:203
310299225,10cyclictest34-21ksoftirqd/310:26:493
3102992217,3cyclictest34-21ksoftirqd/309:00:003
3102992215,5cyclictest34-21ksoftirqd/308:54:593
3101992213,6cyclictest814-21tr08:20:012
3101992213,6cyclictest814-21tr08:20:002
3101992211,9cyclictest6314-21ssh11:21:332
310099222,3cyclictest22305-21diskmemload09:11:091
3100992220,1cyclictest0-21swapper/111:51:461
310099221,9cyclictest220362rm11:57:331
310099221,4cyclictest1806-21runrttasks12:30:221
3100992210,10cyclictest10906-21ssh10:37:141
3099992213,7cyclictest29936-21ls08:10:190
3099992213,7cyclictest28875-21python310:50:230
309999221,11cyclictest22305-21diskmemload11:22:470
66212210,6sleep122-21ksoftirqd/110:34:401
310299218,7cyclictest34-21ksoftirqd/310:55:473
310299213,9cyclictest0-21swapper/309:03:133
3102992116,4cyclictest34-21ksoftirqd/308:10:013
3102992113,6cyclictest12351-21smartctl08:45:193
3102992110,3cyclictest141rcu_preempt08:15:143
3102992110,3cyclictest141rcu_preempt08:15:143
310199218,9cyclictest52750irq/139-enp3s0-11:27:162
310199217,9cyclictest52750irq/139-enp3s0-10:35:252
310199216,10cyclictest52750irq/139-enp3s0-09:05:252
3101992112,7cyclictest10126-21tr11:00:252
310099218,4cyclictest52950irq/141-enp3s0-09:34:541
310099214,3cyclictest22305-21diskmemload10:20:581
310099214,3cyclictest22305-21diskmemload10:13:021
310099214,15cyclictest6502-21ssh09:45:231
310099213,12cyclictest24918-21apt-get12:00:121
310099212,13cyclictest31322-21apt-get08:15:121
310099212,13cyclictest31322-21apt-get08:15:111
3100992113,5cyclictest28334-21sed10:50:181
3100992111,7cyclictest9402-21basename08:40:001
3099992112,7cyclictest5316-21seq08:30:020
3099992111,7cyclictest31428-21cat12:05:010
309999211,11cyclictest22305-21diskmemload10:09:060
310299202,11cyclictest34-21ksoftirqd/308:01:433
310299201,5cyclictest0-21swapper/308:40:183
3102992015,4cyclictest34-21ksoftirqd/307:15:013
3102992012,6cyclictest21569-21sensors09:05:233
3102992011,6cyclictest3201-21find08:25:133
3102992011,6cyclictest18464-21cat07:45:113
310199208,3cyclictest5354-21apt-get08:30:122
310199208,10cyclictest30911-21ssh09:40:102
310199208,10cyclictest24395-21unixbench_singl09:10:242
310199207,9cyclictest52750irq/139-enp3s0-10:32:262
310199207,9cyclictest52750irq/139-enp3s0-09:37:262
310199204,14cyclictest16586-21grep08:55:142
310199203,3cyclictest22305-21diskmemload10:42:252
310199202,16cyclictest19278-21cron10:20:002
3101992012,5cyclictest10704-21expr09:25:122
3101992010,8cyclictest22000-21ssh11:57:312
3101992010,7cyclictest7815-21df08:35:122
310099209,9cyclictest28948-21awk08:09:591
310099207,4cyclictest52950irq/141-enp3s0-09:38:541
310099203,3cyclictest22305-21diskmemload10:00:341
310099201,5cyclictest0-21swapper/110:26:291
309999201,9cyclictest22305-21diskmemload10:41:070
309999201,8cyclictest22305-21diskmemload10:03:320
309999201,8cyclictest0-21swapper/009:58:470
309999201,6cyclictest10155-21cp11:25:020
3099992012,6cyclictest25861-21pluginstate08:00:200
309999201,17cyclictest560-21dbus-daemon11:00:010
3099992011,7cyclictest18965-21users09:30:270
310299198,3cyclictest141rcu_preempt07:40:203
3102991913,4cyclictest34-21ksoftirqd/308:15:003
310199193,2cyclictest141rcu_preempt12:03:152
310199193,13cyclictest30263-21gunzip08:10:232
310199192,12cyclictest25276-21apt-get10:00:112
310199191,8cyclictest20850-21sed10:20:212
310199191,4cyclictest0-21swapper/207:55:132
3101991911,6cyclictest28335-21cat10:50:192
3101991911,6cyclictest28004-21pluginstate08:05:222
3101991911,6cyclictest14371-21uniq08:50:152
3101991910,6cyclictest560-21dbus-daemon08:25:012
3101991910,6cyclictest19813-21cat07:45:242
310099198,7cyclictest278-21systemd-journal08:30:211
310099191,5cyclictest0-21swapper/110:57:211
310099191,5cyclictest0-21swapper/110:16:151
3100991913,3cyclictest16878-21cut07:40:151
309999198,8cyclictest9147-21df11:00:140
309999192,12cyclictest7492-21apt-get08:35:120
309999191,9cyclictest22305-21diskmemload09:35:060
309999191,8cyclictest22305-21diskmemload10:16:370
3099991913,4cyclictest3727-21sh10:31:460
3099991912,5cyclictest23905-21sensors_temp07:55:220
3099991912,5cyclictest11283-21seq08:41:530
3099991911,6cyclictest925-21cut08:20:010
3099991911,6cyclictest925-21cut08:20:000
3099991911,6cyclictest4896-21seq08:27:330
3099991911,6cyclictest3576-21tune2fs07:10:150
3099991911,6cyclictest20187-21seq07:47:560
3099991911,6cyclictest11943-21expr08:45:160
309999190,16cyclictest6126-21seq10:10:030
310299186,9cyclictest141rcu_preempt08:20:153
310299182,11cyclictest5354-21apt-get08:30:133
310199182,11cyclictest18229-21apt-get09:00:132
3101991811,5cyclictest4516-21cat08:25:252
310099181,3cyclictest141rcu_preempt10:42:051
3100991812,4cyclictest13675-21sh08:49:591
3100991811,5cyclictest3442-21expr08:25:151
3100991811,5cyclictest30995-21seq08:14:141
3100991811,4cyclictest17956-21sendmail09:00:001
3100991810,5cyclictest1342-21expr08:20:141
309999181,6cyclictest22305-21diskmemload10:25:510
3099991813,3cyclictest7292-21sh10:35:070
3099991813,3cyclictest17403-21processes07:40:210
3099991811,5cyclictest15054-21which08:50:220
3099991811,4cyclictest27377-21sh08:05:160
3099991810,5cyclictest16157-21grep08:55:120
310199179,6cyclictest5616-21df_inode07:15:142
310199171,13cyclictest13314-21vmstat08:45:282
310099179,6cyclictest25826-21ntp_states08:00:201
310099179,5cyclictest23406-21kernelversion07:55:161
310099179,5cyclictest19011-21cut07:45:151
310099172,11cyclictest18722-21apt-get09:00:181
3100991710,5cyclictest14245-21expr08:50:131
3099991713,2cyclictest18228-21apt09:00:110
3099991711,4cyclictest20414-21apt-get09:05:110
310199169,5cyclictest25087-21ls08:00:122
310199162,8cyclictest9653-21apt-get08:40:132
310199161,13cyclictest3942-21sort07:10:192
310099169,4cyclictest0-21swapper/109:05:111
3099991611,3cyclictest1413-21forks08:20:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional