You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 20:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Mon May 11, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1093729949,45sleep00-21swapper/007:08:180
1079129466,8sleep30-21swapper/307:06:243
1083729380,9sleep20-21swapper/207:07:012
1084129275,13sleep10-21swapper/107:07:041
99302690,0sleep20-21swapper/210:49:342
1116099300,29cyclictest0-21swapper/210:32:592
1115699300,1cyclictest0-21swapper/110:52:101
1116299290,28cyclictest26571-21grep12:35:283
1116099290,28cyclictest0-21swapper/210:41:492
1116099290,28cyclictest0-21swapper/209:14:372
1116299280,24cyclictest0-21swapper/312:14:593
1116299270,26cyclictest0-21swapper/310:14:023
1116299270,26cyclictest0-21swapper/309:05:133
1116299270,25cyclictest0-21swapper/309:15:153
1116299270,20cyclictest0-21swapper/312:06:433
1116099270,26cyclictest0-21swapper/209:05:132
1116299260,25cyclictest0-21swapper/311:25:003
1116099260,25cyclictest0-21swapper/211:50:132
1116099260,25cyclictest0-21swapper/210:55:142
1115699260,26cyclictest0-21swapper/109:37:111
1116299254,20cyclictest26417-21ssh10:40:133
1116099255,19cyclictest3742-21diskmemload12:21:172
11160992518,6cyclictest55650irq/127-enp2s0-11:19:162
1116099251,23cyclictest3742-21diskmemload10:23:442
1116099250,24cyclictest3742-21diskmemload09:56:532
1116099250,24cyclictest0-21swapper/212:30:152
1116099250,24cyclictest0-21swapper/209:52:202
1116099250,19cyclictest0-21swapper/209:00:132
1116299241,22cyclictest16823-21runrttasks09:36:033
1116299241,16cyclictest0-21swapper/309:30:553
1116299240,7cyclictest0-21swapper/311:40:473
1116299240,22cyclictest3742-21diskmemload09:43:453
1116299240,20cyclictest3742-21diskmemload10:07:473
1116299240,20cyclictest0-21swapper/308:45:143
1116099247,15cyclictest3742-21diskmemload12:13:472
1116099240,21cyclictest0-21swapper/209:20:112
1116099240,20cyclictest0-21swapper/211:10:312
1116299236,16cyclictest3742-21diskmemload10:51:273
1116299231,21cyclictest0-21swapper/311:50:133
1116299231,19cyclictest3742-21diskmemload10:24:053
1116299230,22cyclictest0-21swapper/311:19:543
1116099231,21cyclictest3742-21diskmemload11:57:332
1116099231,17cyclictest4609-21date11:25:002
1116099230,3cyclictest0-21swapper/210:16:192
1116099230,23cyclictest0-21swapper/211:02:152
1116099230,23cyclictest0-21swapper/210:36:452
1116099230,22cyclictest3742-21diskmemload09:30:232
1116099230,22cyclictest0-21swapper/209:15:152
1116099230,19cyclictest0-21swapper/209:45:122
1116099230,18cyclictest0-21swapper/208:45:142
1115699231,5cyclictest0-21swapper/111:10:321
1116299221,20cyclictest3742-21diskmemload10:16:433
1116299221,19cyclictest3742-21diskmemload11:35:563
1116299220,21cyclictest3742-21diskmemload09:21:503
1116299220,21cyclictest0-21swapper/311:45:223
1116099223,18cyclictest3742-21diskmemload10:02:102
1116099222,17cyclictest3742-21diskmemload12:35:462
1116099221,20cyclictest5274-21expr11:25:142
1116099221,20cyclictest0-21swapper/208:15:112
1116099220,15cyclictest0-21swapper/211:48:292
1115699220,21cyclictest0-21swapper/111:33:091
1115699220,1cyclictest0-21swapper/110:06:391
1116299214,16cyclictest19426-21apache_processe10:55:143
1116299212,18cyclictest3742-21diskmemload10:04:123
1116299212,16cyclictest3742-21diskmemload09:25:223
1116299211,19cyclictest0-21swapper/311:00:133
1116299210,20cyclictest0-21swapper/308:10:133
1116299210,19cyclictest0-21swapper/311:08:393
1116299210,18cyclictest0-21swapper/309:56:343
1116299210,16cyclictest0-21swapper/308:15:113
1116099215,15cyclictest3742-21diskmemload12:26:532
1116099211,19cyclictest3742-21diskmemload09:41:192
1116299201,18cyclictest3742-21diskmemload10:33:373
1116299200,18cyclictest0-21swapper/309:49:143
1116299200,13cyclictest0-21swapper/311:32:383
1116099202,9cyclictest12691-21sh10:12:332
1116099202,17cyclictest3742-21diskmemload12:19:212
1116099201,11cyclictest0-21swapper/212:00:352
1115699209,1cyclictest0-21swapper/109:25:111
1115699207,4cyclictest0-21swapper/109:22:481
1115699203,16cyclictest0-21swapper/109:42:181
1115699200,19cyclictest0-21swapper/109:15:301
1116299198,8cyclictest26006-21sh12:15:493
1116299197,9cyclictest3571-21rm12:22:033
1116299193,15cyclictest3742-21diskmemload11:27:193
1116299191,17cyclictest0-21swapper/310:25:133
1116299190,18cyclictest3742-21diskmemload11:56:403
1116299190,18cyclictest0-21swapper/309:14:253
1116299190,16cyclictest0-21swapper/309:00:133
1116099192,16cyclictest3742-21diskmemload10:27:032
1116099192,16cyclictest3742-21diskmemload09:36:032
1116099192,16cyclictest30547-21latency_hist07:50:012
1116099192,12cyclictest7825-21aten2_r7power_c08:10:152
1116099190,19cyclictest0-21swapper/209:25:252
1116099190,18cyclictest7553-21grep12:05:182
1116099190,18cyclictest0-21swapper/211:35:562
1116099190,18cyclictest0-21swapper/208:40:132
1116099190,16cyclictest3742-21diskmemload11:08:382
1116099190,15cyclictest0-21swapper/211:30:132
1116299188,10cyclictest3742-21diskmemload10:35:173
1116299187,8cyclictest23078-21taskset07:32:243
1116299186,11cyclictest14773-21cat09:55:003
1116299183,14cyclictest17621-21sh11:13:073
1116299181,16cyclictest3742-21diskmemload10:45:153
1116299180,17cyclictest15446-21sed08:25:153
1116299180,17cyclictest0-21swapper/312:30:153
1116299180,17cyclictest0-21swapper/312:29:473
1116099187,8cyclictest25535-21taskset07:38:282
1116099181,16cyclictest15445-21df08:25:152
1116099180,18cyclictest0-21swapper/210:53:582
1116099180,18cyclictest0-21swapper/210:09:592
1116099180,17cyclictest0-21swapper/211:41:512
1115699189,2cyclictest7040-21basename09:50:151
1115699189,2cyclictest31353-21uname11:40:211
1115699182,15cyclictest0-21swapper/111:45:131
11156991817,1cyclictest0-21swapper/111:35:321
1115699180,1cyclictest0-21swapper/109:59:521
1115699180,1cyclictest0-21swapper/109:46:141
1115399181,1cyclictest141rcu_preempt11:02:300
1116299175,11cyclictest5637-21sh12:04:313
1116299170,16cyclictest0-21swapper/308:40:133
1116099170,14cyclictest0-21swapper/207:20:142
1115699179,2cyclictest732-21cut12:20:201
1115699178,3cyclictest6853-21ssh12:05:151
11156991714,2cyclictest0-21swapper/110:30:521
11156991710,2cyclictest30932-21grep07:50:151
11153991717,0cyclictest0-21swapper/010:12:430
1116299162,13cyclictest19427-21cron08:35:013
1116299161,14cyclictest32249-21ls07:50:263
1116099169,6cyclictest20183-21cat07:25:242
1116099169,6cyclictest20183-21cat07:25:242
1116099161,14cyclictest21914-21gltestperf07:30:172
1115699167,2cyclictest6908-21cat08:05:251
1115699163,0cyclictest0-21swapper/112:10:131
1115699162,12cyclictest19431-21apache_processe10:55:131
1115699160,0cyclictest0-21swapper/109:11:591
1115399163,10cyclictest0-21swapper/008:05:130
1115399161,7cyclictest17086-21perf08:30:000
1116299158,6cyclictest29803-21threads07:45:263
1116299158,6cyclictest24792-21tr07:35:203
1116299150,14cyclictest20379-21fschecks_time08:35:153
1116299150,11cyclictest0-21swapper/308:00:123
1116099159,5cyclictest12340-21grep07:10:182
1116099158,6cyclictest28488-21cat08:50:242
1116099150,14cyclictest0-21swapper/208:30:142
1116099150,14cyclictest0-21swapper/208:00:122
1116099150,13cyclictest0-21swapper/207:50:222
1115699150,1cyclictest0-21swapper/111:24:511
1115399157,2cyclictest225-21systemd-journal09:00:320
1115399153,6cyclictest0-21swapper/010:42:410
1115399152,10cyclictest1262-21ssh10:25:140
11153991512,2cyclictest3742-21diskmemload09:17:070
11153991512,2cyclictest1142-21runrttasks08:30:140
11153991511,2cyclictest13-21ksoftirqd/011:21:260
1116299148,5cyclictest2378-21sed07:55:273
1116299148,5cyclictest14403-21expr07:15:153
1116299147,6cyclictest31379-21cron09:00:013
1116299140,13cyclictest0-21swapper/308:20:143
1116099148,5cyclictest27500-21ls07:40:262
1116099147,6cyclictest31332-21chrt08:59:282
1115699148,5cyclictest2756-21cron08:00:001
1115699143,1cyclictest141rcu_preempt10:28:021
1115699142,1cyclictest25247-21sh11:55:581
1115699140,1cyclictest0-21swapper/110:44:191
1115699140,14cyclictest0-21swapper/112:25:171
1115399149,5cyclictest13-21ksoftirqd/009:42:550
1115399141,6cyclictest12787-21munin-run11:30:000
11153991411,2cyclictest15668-21grep11:50:220
11153991410,4cyclictest9309-21sh09:12:510
202682130,2sleep10-21swapper/112:32:061
1116299137,5cyclictest27918-21taskset07:43:193
1116299137,5cyclictest19851-21grep07:25:203
1116299137,5cyclictest19851-21grep07:25:193
1116299136,6cyclictest16640-21tr07:20:153
1116299130,9cyclictest5412-21basename08:05:123
1116299130,12cyclictest0-21swapper/308:50:123
1116099137,5cyclictest20082-21expr08:35:142
11160991310,2cyclictest13352-21tail08:20:172
1116099130,12cyclictest6759-21awk08:05:222
1116099130,11cyclictest0-21swapper/207:55:192
1115699139,3cyclictest30038-21cut08:55:171
1115699139,3cyclictest25446-21ssh12:35:181
11156991310,2cyclictest14682-21grep07:15:161
1115699130,13cyclictest0-21swapper/111:00:261
1115699130,13cyclictest0-21swapper/110:23:391
1115699130,12cyclictest9364-21cut10:10:221
1115399139,3cyclictest6422-21ssh09:50:000
1115399139,3cyclictest2895-21uname09:05:220
1115399139,3cyclictest20259-21grep10:55:180
11153991310,2cyclictest25392-21cut12:35:180
11153991310,2cyclictest23819-21grep12:15:150
11153991310,2cyclictest15214-21grep07:15:210
11153991310,2cyclictest14080-21grep11:30:170
11153991310,2cyclictest13654-21sh11:50:000
1116299125,6cyclictest12379-21sort07:10:183
1115699129,2cyclictest8523-21grep08:10:181
1115699129,2cyclictest6449-21wc11:25:221
1115699129,2cyclictest25149-21cut08:45:171
1115699129,2cyclictest24795-21grep07:35:211
1115699129,2cyclictest22243-21wc07:30:191
1115699129,2cyclictest2220-21chrt12:01:501
1115699129,2cyclictest18819-21cut10:35:171
1115699129,2cyclictest18092-21sed08:30:181
1115699129,2cyclictest16615-21sed08:25:261
1115699129,2cyclictest13033-21sed07:10:261
1115699128,3cyclictest31741-21wget09:00:131
1115699128,3cyclictest16609-21tr07:20:151
1115699128,2cyclictest12720-21tr08:20:141
1115699121,8cyclictest14562-21kworker/1:108:40:131
1115699121,3cyclictest0-21swapper/109:30:131
1115699121,10cyclictest0-21swapper/110:01:521
1115699120,1cyclictest0-21swapper/110:47:491
1115399129,2cyclictest7607-21grep12:05:180
1115399129,2cyclictest31454-21df12:00:160
1115399129,2cyclictest30396-21cron12:00:000
1115399129,2cyclictest29639-21grep09:25:140
1115399129,2cyclictest24414-21wc08:45:000
1115399129,2cyclictest19971-21grep08:35:140
1115399129,2cyclictest16844-21sensors09:55:250
1115399128,2cyclictest19980-21grep07:25:220
1115399128,2cyclictest19980-21grep07:25:210
1116099117,3cyclictest157422sleep207:15:422
1115699118,2cyclictest8414-21chrt11:07:291
1115699118,2cyclictest29110-21cut07:45:181
1115699118,2cyclictest23635-21ssh12:15:141
1115699118,2cyclictest21453-21grep11:15:181
1115699118,2cyclictest20986-21ssh11:54:101
1115699118,2cyclictest20028-21expr08:35:151
1115699118,2cyclictest1885-21tr09:05:141
1115699118,2cyclictest16691-21cut10:15:131
1115699110,10cyclictest11682-21cat08:15:231
1115399118,2cyclictest8333-21wc09:50:230
1115399118,2cyclictest8260-21ssh11:07:220
1115399118,2cyclictest7864-21ssh09:30:340
1115399118,2cyclictest7710-21ssh12:25:080
1115399118,2cyclictest7322-21ssh10:09:530
1115399118,2cyclictest3129-21ssh12:21:440
1115399118,2cyclictest303-21chrt11:41:030
1115399118,2cyclictest2946-21cut10:45:160
1115399118,2cyclictest26102-21wc08:45:250
1115399118,2cyclictest2567-21sshd07:57:350
1115399118,2cyclictest23810-21tr07:35:140
1115399118,2cyclictest23789-21ssh09:20:520
1115399118,2cyclictest20931-21grep11:15:160
1115399118,2cyclictest18884-21sed10:35:170
1115399118,2cyclictest18096-21grep07:20:280
1115399118,2cyclictest17133-21chrt12:10:270
1115399118,2cyclictest16630-21expr12:30:170
1115399118,2cyclictest15422-21ssh11:11:260
1115399118,2cyclictest14263-21grep09:35:150
1115399118,2cyclictest13314-21head08:20:160
1115399118,2cyclictest13242-21ssh10:50:360
1115399118,2cyclictest11878-21grep08:15:240
1115399118,2cyclictest10297-21grep10:30:170
1115399117,3cyclictest18013-21ssh10:15:210
1115399117,2cyclictest9413-21sed08:10:270
1115699108,1cyclictest29073-21sed08:55:001
1115699108,1cyclictest20824-21chrt07:28:591
1115699108,1cyclictest20824-21chrt07:28:581
1115699107,2cyclictest26202-21tr07:40:151
1115699101,7cyclictest0-21swapper/108:00:121
1115399108,2cyclictest26341-21ntpq10:20:220
1115399108,1cyclictest324972sleep007:51:050
1115399108,1cyclictest29886-21grep08:55:170
1115399108,1cyclictest27428-21grep07:40:260
1115399108,1cyclictest23928-21cut10:00:160
1115399107,2cyclictest3797-21grep08:00:170
1115399107,2cyclictest28332-21apache_volume07:45:130
1115399107,2cyclictest27017-21basename08:50:120
1115399107,2cyclictest22785-21unixbench-2d07:30:250
1115399107,2cyclictest21607-21ssh11:35:070
1115399107,2cyclictest11623-21grep07:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional