You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 01:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Fri Sep 11, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3175929568,9sleep00-21swapper/007:07:420
3189229480,9sleep20-21swapper/207:09:242
3188128673,9sleep30-21swapper/307:09:183
3160627868,6sleep10-21swapper/107:05:411
236432600,0sleep00-21swapper/011:05:160
7572410,0sleep3758-21ssh09:15:033
3202999250,1cyclictest0-21swapper/211:52:052
3202999250,1cyclictest0-21swapper/211:52:042
3202999250,17cyclictest0-21swapper/210:05:132
3202699251,20cyclictest24395-21diskmemload10:14:301
246332240,0sleep20-21swapper/209:29:152
3202999231,20cyclictest0-21swapper/209:41:182
32026992310,8cyclictest30746-21munin-run11:10:001
3202699230,23cyclictest0-21swapper/111:48:371
3203299221,20cyclictest17843-21ssh12:00:123
3202999220,20cyclictest0-21swapper/210:34:382
3202499220,1cyclictest0-21swapper/011:15:510
3203299212,17cyclictest19014-21sh12:20:133
3202699211,19cyclictest0-21swapper/112:00:131
3202699210,19cyclictest0-21swapper/110:08:041
3202499210,21cyclictest0-21swapper/012:03:110
3203299207,7cyclictest2414-21apt-get12:10:183
3202999200,20cyclictest0-21swapper/212:15:562
3202699201,1cyclictest0-21swapper/111:10:171
3202699200,0cyclictest0-21swapper/110:18:181
3203299190,19cyclictest0-21swapper/309:41:583
3202999197,8cyclictest0-21swapper/209:50:172
3202999191,17cyclictest0-21swapper/209:49:452
32026991915,3cyclictest0-21swapper/110:00:131
32026991915,3cyclictest0-21swapper/110:00:121
32024991918,1cyclictest13-21ksoftirqd/009:58:550
32024991916,2cyclictest13-21ksoftirqd/010:00:430
32024991916,2cyclictest13-21ksoftirqd/010:00:430
3203299180,2cyclictest0-21swapper/312:15:413
3202999180,17cyclictest0-21swapper/212:28:082
32026991817,1cyclictest0-21swapper/111:40:151
3202699180,1cyclictest0-21swapper/112:11:201
3203299170,16cyclictest0-21swapper/310:29:013
3202699173,13cyclictest24395-21diskmemload11:38:311
3202499177,9cyclictest0-21swapper/011:47:530
32024991716,1cyclictest13-21ksoftirqd/011:44:570
32029991614,1cyclictest19920-21ls12:20:182
3202999160,7cyclictest0-21swapper/210:17:352
3202999160,13cyclictest0-21swapper/209:24:182
3202999160,12cyclictest0-21swapper/212:00:102
3202699160,1cyclictest141rcu_preempt09:21:411
3203299152,12cyclictest9455-21sh11:55:123
3202999156,7cyclictest1604-21munin-run12:10:012
32029991511,3cyclictest26865-21wc11:45:242
32029991511,3cyclictest20724-21ls09:00:182
3202999150,15cyclictest0-21swapper/209:16:432
3202999150,13cyclictest0-21swapper/210:28:132
32026991510,3cyclictest4644-21wc09:55:221
32026991510,3cyclictest10308-21wc08:40:011
32032991411,2cyclictest24771-21expr11:25:143
32032991411,2cyclictest0-21swapper/309:32:353
32032991410,3cyclictest3035-21sed11:50:263
32032991410,3cyclictest3035-21sed11:50:263
3202999147,6cyclictest32-21ksoftirqd/207:45:252
3202999143,10cyclictest0-21swapper/209:38:512
3202999141,1cyclictest141rcu_preempt10:10:162
32029991410,3cyclictest26808-21wc09:10:252
32029991410,3cyclictest19337-21cron10:05:002
32029991410,3cyclictest19337-21cron10:04:592
3202999140,13cyclictest0-21swapper/211:59:582
32026991411,2cyclictest11374-21grep11:55:251
3202699141,11cyclictest1997-21ssh09:35:131
3202699140,3cyclictest0-21swapper/111:26:141
3202699140,1cyclictest0-21swapper/110:55:001
3202699140,13cyclictest19633-21wc12:40:001
3202699140,13cyclictest0-21swapper/112:16:481
3202499142,6cyclictest1621-21perf12:10:000
3202499141,6cyclictest25834-21awk08:05:000
32024991411,2cyclictest28858-21wc09:50:260
32024991411,2cyclictest26496-21ls09:10:210
32024991410,2cyclictest30338-21grep10:30:200
32024991410,2cyclictest18577-21sed09:25:170
3203299139,3cyclictest9880-21basename09:39:593
3203299139,3cyclictest6857-21grep11:15:003
3203299139,3cyclictest4628-21wc12:30:263
3203299139,3cyclictest23493-21ls09:05:223
32032991312,0cyclictest0-21swapper/310:59:493
32032991310,2cyclictest9676-21sed08:35:273
32032991310,2cyclictest17358-21grep11:20:223
32032991310,2cyclictest10126-21grep09:20:173
3203299130,2cyclictest0-21swapper/310:34:393
3202999139,2cyclictest30310-21tr10:50:162
3202999136,7cyclictest310172sleep209:32:462
32029991312,0cyclictest0-21swapper/211:09:562
32029991311,1cyclictest0-21swapper/211:23:582
32029991310,2cyclictest9309-21wc08:35:222
32029991310,2cyclictest32231-21grep11:10:162
32029991310,2cyclictest13399-21grep07:35:272
32029991310,2cyclictest12772-21tr10:20:132
3202999130,13cyclictest0-21swapper/209:56:062
32026991310,2cyclictest7024-21grep10:35:271
32026991310,2cyclictest22033-21sleep09:05:001
32026991310,2cyclictest16362-21head08:50:201
3202499139,3cyclictest32588-21cat11:10:180
3202499139,3cyclictest2769-21ssh11:50:250
3202499139,3cyclictest2769-21ssh11:50:250
3202499138,3cyclictest28197-21apt08:10:000
32024991310,2cyclictest27962-21cat09:30:280
32024991310,2cyclictest17201-21tune2fs07:45:150
32024991310,2cyclictest1454-21grep07:10:260
32024991310,2cyclictest11533-21turbostat07:34:590
32024991310,2cyclictest10903-21tr09:40:130
3202499130,3cyclictest0-21swapper/012:27:420
3202499130,1cyclictest141rcu_preempt11:22:230
3202499130,1cyclictest0-21swapper/009:22:350
3202499130,12cyclictest24383-21cron09:09:590
3203299129,2cyclictest9300-21wc07:30:003
3203299129,2cyclictest29637-21grep10:10:263
3203299129,2cyclictest2516-21sed08:20:263
3203299129,2cyclictest16931-21aten2_r7power_p11:40:133
3203299129,2cyclictest13540-21grep08:45:173
3203299129,2cyclictest10239-21cat11:35:263
3203299128,3cyclictest30725-21cron11:09:593
3203299128,2cyclictest6218-21sort08:30:173
3203299125,4cyclictest12197-21sh10:39:283
3203299125,2cyclictest15877-21sh10:21:313
3203299120,3cyclictest0-21swapper/308:50:113
3203299120,11cyclictest4914-21head10:15:153
3203299120,10cyclictest0-21swapper/310:09:413
3202999129,2cyclictest25343-21sed08:00:252
3202999129,2cyclictest22056-21sed07:55:182
3202999129,2cyclictest1901-21grep08:20:202
3202999129,2cyclictest18786-21head11:40:252
3202999129,2cyclictest12416-21tail12:35:152
3202999129,2cyclictest10612-21sed07:30:222
3202999129,2cyclictest10423-21cut08:40:152
32029991210,1cyclictest2351-21grep07:15:132
3202999120,4cyclictest0-21swapper/210:44:552
3202699129,2cyclictest812-21wc07:10:201
3202699129,2cyclictest4198-21cut12:30:221
3202699129,2cyclictest31105-21tr08:15:131
3202699129,2cyclictest28672-21tr08:10:141
3202699129,2cyclictest28672-21tr08:10:141
3202699129,2cyclictest28212-21head09:50:211
3202699129,2cyclictest27739-21tail08:05:251
3202699129,2cyclictest26809-21wc09:50:001
3202699129,2cyclictest26460-21grep09:30:171
3202699129,2cyclictest26334-21wget12:05:131
3202699129,2cyclictest25916-21head09:10:161
3202699129,2cyclictest16775-21grep11:20:161
3202699129,2cyclictest1295-21tr09:15:131
3202699129,2cyclictest12562-21cat08:45:001
3202699128,3cyclictest29196-21grep12:25:251
3202699128,3cyclictest22294-21cat07:55:201
3202699127,4cyclictest9403-21ssh11:15:281
3202699127,4cyclictest21308-21ssh12:20:401
3202699127,2cyclictest18531-21ssh11:01:591
3202699126,2cyclictest225-21systemd-journal07:25:001
3202699124,7cyclictest7048-21apt-get07:25:141
32026991210,1cyclictest13795-21chrt10:20:191
3202699120,6cyclictest225-21systemd-journal10:45:001
3202699120,3cyclictest0-21swapper/110:59:131
3202699120,3cyclictest0-21swapper/107:46:321
3202699120,11cyclictest7916-21ls08:35:011
3202499129,2cyclictest7737-21basename08:35:010
3202499129,2cyclictest6064-21ssh10:55:140
3202499129,2cyclictest5399-21tr10:35:150
3202499129,2cyclictest25065-21head11:25:160
3202499129,2cyclictest23994-21seq10:45:390
3202499129,2cyclictest21125-21tr10:25:140
3202499129,2cyclictest19533-21sort07:50:150
3202499129,2cyclictest19039-21cut09:45:140
3202499129,2cyclictest1843-21tail09:15:160
3202499129,2cyclictest16459-21grep11:00:270
3202499129,2cyclictest15342-21sed10:40:260
3202499129,2cyclictest14323-21grep07:40:140
3202499129,2cyclictest13892-21cron07:40:000
3202499129,2cyclictest13703-21tail10:20:180
3202499129,2cyclictest10213-21cat12:15:010
3202499129,2cyclictest10101-21sh08:40:010
3202499124,7cyclictest9173-21basename07:30:000
3202499120,2cyclictest0-21swapper/011:35:050
3202499120,1cyclictest0-21swapper/012:23:120
3202499120,11cyclictest14449-21grep08:45:260
3203299118,2cyclictest941-21ssh10:51:303
3203299118,2cyclictest7062-21ssh09:56:543
3203299118,2cyclictest5094-21taskset08:26:493
3203299118,2cyclictest4920-21grep07:20:143
3203299118,2cyclictest440-21grep07:10:173
3203299118,2cyclictest32272-21ssh12:27:443
3203299118,2cyclictest308-21aten2_r7power_c11:30:203
3203299118,2cyclictest30547-21rm09:13:083
3203299118,2cyclictest26815-21head08:05:173
3203299118,2cyclictest26037-21ssh12:05:073
3203299118,2cyclictest24988-21sh11:45:073
3203299118,2cyclictest24663-21expr08:00:183
3203299118,2cyclictest23272-21sh10:45:223
3203299118,2cyclictest2268-21grep07:15:123
3203299118,2cyclictest20636-21head07:50:243
3203299118,2cyclictest19332-21expr09:45:153
3203299118,2cyclictest17856-21expr08:55:143
3203299118,2cyclictest17636-21ssh09:25:083
3203299118,2cyclictest15742-21sh10:40:403
3203299118,2cyclictest15112-21ssh11:00:163
3203299118,2cyclictest14039-21ssh12:35:463
3203299118,2cyclictest11538-21ssh11:17:073
3203299118,2cyclictest11298-21ssh10:00:033
3203299118,2cyclictest11298-21ssh10:00:023
3203299118,2cyclictest10424-21tr08:40:153
3203299112,2cyclictest225-21systemd-journal07:35:003
3203299110,10cyclictest30772-21ssh09:51:383
3202999119,1cyclictest4817-21wc07:20:142
3202999118,2cyclictest7291-21sed08:30:262
3202999118,2cyclictest6044-21basename10:55:132
3202999118,2cyclictest5934-21grep10:35:182
3202999118,2cyclictest5727-21ssh12:11:322
3202999118,2cyclictest5029-21ssh11:32:362
3202999118,2cyclictest4060-21ls08:25:172
3202999118,2cyclictest29718-21uname08:10:222
3202999118,2cyclictest29718-21uname08:10:222
3202999118,2cyclictest26456-21ssh10:47:372
3202999118,2cyclictest23883-21grep09:05:262
3202999118,2cyclictest16203-21sh11:00:252
3202999118,2cyclictest15767-21cut08:50:142
3202999118,2cyclictest15216-21wc07:40:182
3202999118,2cyclictest12455-21chrt11:36:592
3202999113,4cyclictest225-21systemd-journal08:17:252
3202999111,8cyclictest0-21swapper/208:55:132
3202999111,2cyclictest141rcu_preempt08:45:172
3202999110,1cyclictest0-21swapper/212:30:252
3202999110,10cyclictest0-21swapper/211:15:282
3202699118,2cyclictest4016-21ssh11:51:071
3202699118,2cyclictest4016-21ssh11:51:061
3202699118,2cyclictest29226-21tr10:30:141
3202699118,2cyclictest24820-21taskset08:00:191
3202699118,2cyclictest23041-21ssh10:25:371
3202699118,2cyclictest20602-21grep07:50:251
3202699118,2cyclictest18434-21cut09:25:151
3202699118,2cyclictest10705-21grep09:40:141
3202699110,5cyclictest23031-21grep09:05:171
3202699110,1cyclictest0-21swapper/110:45:291
3202499119,1cyclictest23435-21awk07:59:590
3202499118,2cyclictest6987-21cat07:24:590
3202499118,2cyclictest5194-21ssh09:36:210
3202499118,2cyclictest3928-21ssh10:15:040
3202499118,2cyclictest32608-21chrt08:15:490
3202499118,2cyclictest30711-21ssh10:50:170
3202499118,2cyclictest3012-21hostname07:15:160
3202499118,2cyclictest28995-21cut10:10:200
3202499118,2cyclictest2352-21wc08:20:260
3202499118,2cyclictest21365-21cat09:00:260
3202499118,2cyclictest21220-21sed10:05:220
3202499118,2cyclictest13747-21ssh11:57:140
3202499118,2cyclictest12528-21sort08:45:000
3202499118,2cyclictest12281-21grep12:35:160
3202499118,2cyclictest1148-21grep11:30:230
3202499116,4cyclictest24395-21diskmemload12:19:160
3203299108,1cyclictest32433-21expr08:15:253
3203299108,1cyclictest29410-21wc08:10:193
3203299108,1cyclictest29410-21wc08:10:193
3203299108,1cyclictest232382sleep307:57:533
3203299108,1cyclictest183662sleep307:46:153
3203299107,2cyclictest20289-21ls09:00:163
3203299107,2cyclictest12930-21ntpq07:35:223
3203299100,9cyclictest15021-21cat07:40:183
3202999108,1cyclictest208052sleep207:52:072
3202999108,1cyclictest18402sleep207:13:492
3202999107,2cyclictest8498-21cat07:25:252
3202999107,2cyclictest26325-21cut08:05:142
3202999107,2cyclictest24276-21apache_volume11:25:122
3202699108,1cyclictest5143-21taskset08:27:281
3202699108,1cyclictest2340-21basename07:15:131
3202699108,1cyclictest14538-21chrt08:45:561
3202699108,1cyclictest0-21swapper/107:40:201
3202699107,2cyclictest32530-21ssh11:30:091
3202699106,2cyclictest12069-21grep07:35:161
3202699101,2cyclictest225-21systemd-journal08:58:251
3202499108,1cyclictest3297-21aten2_r7power_v08:25:140
3202499108,1cyclictest3251-21rm12:30:140
3202499108,1cyclictest29204-21tail08:10:170
3202499108,1cyclictest29204-21tail08:10:170
3202499108,1cyclictest15513-21expr08:50:140
3202499100,9cyclictest18278-21tail08:55:160
320269997,1cyclictest2865-21taskset08:24:251
320269992,6cyclictest9639-21cpuspeed_turbos07:30:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional