You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 23:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Fri Mar 13, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24879911551127,25cyclictest0-21swapper/007:26:400
24889910991090,6cyclictest0-21swapper/107:26:561
20632620575,30sleep00-21swapper/007:21:200
22702562518,29sleep10-21swapper/107:23:271
17202910,5sleep1201rcuc/112:20:271
49232830,8sleep1248899cyclictest11:16:571
248799741,13cyclictest12080-21grep10:50:280
87942690,2sleep08791-21cat09:05:020
274012680,5sleep1201rcuc/110:00:121
248799667,28cyclictest0-21swapper/011:46:360
2487996328,4cyclictest0-21swapper/011:17:550
2487996327,5cyclictest0-21swapper/011:07:560
248799602,31cyclictest12852-21df_inode09:45:150
196922560,6sleep12206-21dbus-daemon11:32:241
202302550,2sleep120231-21sh09:19:501
71562490,8sleep1248899cyclictest10:12:261
237102430,5sleep1211ktimersoftd/111:36:141
248899416,31cyclictest0-21swapper/110:27:361
133892400,23sleep122-21ksoftirqd/109:45:251
57422390,6sleep10-21swapper/107:30:141
248799397,5cyclictest81rcu_preempt12:16:070
248799397,5cyclictest81rcu_preempt09:25:250
248799394,32cyclictest0-21swapper/011:56:350
248799392,12cyclictest0-21swapper/009:37:200
173052391,34sleep117318-21sh09:50:071
248899381,34cyclictest0-21swapper/110:42:161
294602370,4sleep0111rcuc/010:35:230
264822361,31sleep126487-21diskstats08:25:161
248899366,4cyclictest81rcu_preempt08:51:231
248899364,4cyclictest81rcu_preempt11:25:011
2487993628,4cyclictest5819-21diskstats12:25:150
150122361,31sleep115074-21ps10:20:251
253162351,30sleep125330-21ssh12:11:201
248899356,4cyclictest81rcu_preempt10:48:271
248899352,30cyclictest0-21swapper/112:29:351
248899352,29cyclictest0-21swapper/109:41:361
248799358,5cyclictest81rcu_preempt12:34:510
2487993527,5cyclictest22111-21ssh11:35:160
2487993524,8cyclictest0-21swapper/011:28:350
248799352,20cyclictest3553-21df08:50:140
2487993514,8cyclictest4346-21/usr/sbin/munin10:10:300
2487993510,21cyclictest0-21swapper/012:09:090
176202351,3sleep10-21swapper/112:37:011
259962340,30sleep010643-21diskmemload12:12:200
248899348,23cyclictest0-21swapper/110:17:251
2488993424,6cyclictest10997-21ssh12:30:201
248799347,12cyclictest18908-21sshd10:58:200
248799345,26cyclictest32441-21cron11:11:590
248799345,16cyclictest0-21swapper/009:50:260
248799342,5cyclictest0-21swapper/011:01:160
248799342,29cyclictest0-21swapper/010:47:550
248799341,9cyclictest0-21swapper/008:05:250
248799341,8cyclictest19918-21ssh11:32:440
184842341,29sleep018498-21ssh10:24:500
152092341,29sleep115222-21cron10:55:001
248899335,4cyclictest81rcu_preempt09:10:211
248899335,4cyclictest81rcu_preempt09:10:211
248899334,4cyclictest81rcu_preempt12:40:351
248899333,5cyclictest0-21swapper/108:48:151
248899333,4cyclictest81rcu_preempt11:07:411
248899333,4cyclictest81rcu_preempt09:25:421
248899333,28cyclictest0-21swapper/107:42:361
248899333,28cyclictest0-21swapper/107:42:351
248899331,6cyclictest22131-21rm11:01:001
248899331,6cyclictest18181-21latency_hist12:05:001
248899331,4cyclictest81rcu_preempt10:36:111
248899331,4cyclictest31109-21ssh12:51:361
248899331,29cyclictest24059-21fschecks_count10:30:161
2488993312,7cyclictest22-21ksoftirqd/112:19:081
2488993311,8cyclictest23346-21sensors09:55:281
248799339,5cyclictest30133-21cut08:35:110
248799338,13cyclictest17130-21unixbench_multi09:15:290
248799336,23cyclictest0-21swapper/012:51:130
248799336,13cyclictest28116-21grep08:30:080
248799334,4cyclictest81rcu_preempt12:02:530
248799331,4cyclictest81rcu_preempt12:40:460
248799331,30cyclictest0-21swapper/010:33:160
248799331,29cyclictest5318-21ssh10:44:360
248799331,21cyclictest2789-21cron08:46:590
222192331,5sleep00-21swapper/008:14:410
248899324,4cyclictest81rcu_preempt12:05:111
248899324,4cyclictest81rcu_preempt09:09:451
2488993222,6cyclictest4613-21/usr/sbin/munin11:50:191
248899322,17cyclictest5980-21ntp_states08:55:251
248899321,28cyclictest0-21swapper/111:10:151
248799324,25cyclictest2485-21cyclictest11:54:010
248799323,4cyclictest81rcu_preempt11:40:380
248799322,5cyclictest81rcu_preempt10:06:020
2487993224,6cyclictest0-21swapper/007:45:550
2487993222,6cyclictest17044-21ssh12:36:100
248799321,5cyclictest0-21swapper/009:13:550
248799321,5cyclictest0-21swapper/009:13:550
248799321,29cyclictest0-21swapper/007:54:160
248799321,19cyclictest22479-21ssh09:21:030
135172321,27sleep013530-21ssh10:19:390
40692310,4sleep14066-21cat09:35:271
248899315,4cyclictest81rcu_preempt08:11:371
248899313,4cyclictest81rcu_preempt09:23:111
2488993123,5cyclictest27042-21fschecks_time11:40:161
248899311,3cyclictest0-21swapper/107:56:291
248899311,28cyclictest0-21swapper/111:58:161
2488993112,15cyclictest1363-21ssh10:06:151
248799313,4cyclictest81rcu_preempt12:46:510
248799312,17cyclictest0-21swapper/009:57:470
248799312,15cyclictest7987-21df_inode09:40:130
248799312,13cyclictest0-21swapper/009:33:460
248799311,4cyclictest81rcu_preempt12:21:270
248799311,18cyclictest9678-21irqstats07:40:210
248799311,18cyclictest9678-21irqstats07:40:200
2487993111,7cyclictest6543-21taskset07:30:280
248799310,4cyclictest81rcu_preempt11:22:460
130122315,5sleep122-21ksoftirqd/107:50:081
248899303,4cyclictest81rcu_preempt08:30:481
248899303,4cyclictest81rcu_preempt08:00:311
248899301,4cyclictest81rcu_preempt10:55:521
248899301,4cyclictest81rcu_preempt09:01:291
248899301,27cyclictest0-21swapper/112:46:561
248899301,26cyclictest30843-21grep09:30:161
248899300,4cyclictest81rcu_preempt07:37:291
248799308,5cyclictest19165-21df10:25:120
248799301,4cyclictest81rcu_preempt10:01:560
18682303,4sleep110758-1kworker/1:0H11:47:351
8712291,5sleep00-21swapper/008:42:470
2488992913,5cyclictest81rcu_preempt11:20:221
248799293,20cyclictest17084-21diskstats08:00:130
248799293,13cyclictest24909-21iostat_ios08:20:180
248799292,14cyclictest7779-21iostat_ios07:35:200
237222291,5sleep10-21swapper/108:15:481
202492291,5sleep10-21swapper/108:08:421
8662281,5sleep10-21swapper/108:42:451
256002281,5sleep10-21swapper/108:20:341
2488992811,4cyclictest31673-21latency_hist08:40:001
248799283,14cyclictest0-21swapper/007:55:120
248799282,13cyclictest23434-21python08:15:270
248799281,4cyclictest81rcu_preempt09:05:400
2487992811,5cyclictest5980-21ntp_states08:55:250
2487992810,5cyclictest26765-21if_eth008:25:190
128032261,5sleep10-21swapper/107:49:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional