You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-21 - 16:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Mon Sep 21, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1187329582,9sleep00-21swapper/007:07:280
1183829381,8sleep20-21swapper/207:07:022
1179428867,12sleep30-21swapper/307:06:273
1193428668,13sleep10-21swapper/107:08:171
1216099300,1cyclictest0-21swapper/109:33:051
1216099260,3cyclictest0-21swapper/110:14:321
1215599260,3cyclictest0-21swapper/010:48:120
1216599252,1cyclictest0-21swapper/310:22:203
12162992419,4cyclictest5809-21diskmemload11:16:032
12160992423,1cyclictest0-21swapper/110:35:061
1216099241,1cyclictest28857-21awk11:00:201
1216099240,0cyclictest0-21swapper/110:22:211
12155992416,7cyclictest5809-21diskmemload12:05:250
1215599230,22cyclictest0-21swapper/010:05:130
1216599221,1cyclictest0-21swapper/309:29:133
1216599221,0cyclictest0-21swapper/309:33:053
1216099220,3cyclictest0-21swapper/109:40:551
1216099220,1cyclictest0-21swapper/111:16:391
1216099220,11cyclictest0-21swapper/109:35:151
1216099220,0cyclictest0-21swapper/111:51:101
1216099220,0cyclictest0-21swapper/111:51:101
12155992213,8cyclictest5809-21diskmemload10:51:110
1216599211,2cyclictest0-21swapper/311:16:393
1216599211,1cyclictest0-21swapper/312:35:153
1216099210,1cyclictest0-21swapper/111:31:551
1216099210,1cyclictest0-21swapper/109:25:541
1216099210,1cyclictest0-21swapper/107:45:171
1215599217,13cyclictest13-21ksoftirqd/010:38:300
1216599200,1cyclictest0-21swapper/311:51:113
1216599200,1cyclictest0-21swapper/311:51:103
1216599200,19cyclictest0-21swapper/310:35:063
1216299202,14cyclictest8106-21rm09:50:112
1216099201,0cyclictest0-21swapper/110:25:471
1216099200,4cyclictest0-21swapper/107:30:131
1216099200,2cyclictest0-21swapper/110:16:311
1216099200,0cyclictest0-21swapper/112:15:501
12165991918,1cyclictest0-21swapper/311:42:143
12165991914,4cyclictest5809-21diskmemload10:13:053
12162991918,1cyclictest0-21swapper/211:56:142
1216299190,16cyclictest0-21swapper/210:55:342
12160991918,1cyclictest0-21swapper/112:01:071
1216099190,19cyclictest0-21swapper/109:59:231
1216099190,18cyclictest0-21swapper/112:25:111
12155991918,1cyclictest5809-21diskmemload10:24:150
12155991915,3cyclictest16575-21uniq08:25:160
1216599182,2cyclictest225-21systemd-journal11:22:263
12165991811,1cyclictest13279-21cron08:20:013
1216599180,17cyclictest0-21swapper/311:31:553
1216599180,16cyclictest0-21swapper/310:16:323
1216299180,2cyclictest0-21swapper/210:19:282
1216299180,17cyclictest0-21swapper/207:55:142
1216099181,16cyclictest7617-21latency_hist09:50:011
1216099180,1cyclictest0-21swapper/111:14:371
1216099180,0cyclictest0-21swapper/111:06:481
12155991812,2cyclictest26991-21munin-run10:59:590
1215599180,2cyclictest0-21swapper/011:15:230
1216599172,10cyclictest0-21swapper/311:10:153
12165991716,1cyclictest0-21swapper/310:56:563
1216599170,17cyclictest0-21swapper/309:50:413
1216599170,16cyclictest0-21swapper/310:25:473
1216299173,4cyclictest0-21swapper/210:30:282
12162991714,3cyclictest0-21swapper/212:30:342
12160991714,2cyclictest0-21swapper/112:11:511
1216099170,3cyclictest0-21swapper/112:23:271
1216099170,1cyclictest0-21swapper/112:35:581
1216099170,0cyclictest0-21swapper/111:58:381
1216099170,0cyclictest0-21swapper/111:28:591
1215599179,2cyclictest0-21swapper/010:41:350
1215599175,6cyclictest23161-21munin-run09:40:000
1215599175,11cyclictest0-21swapper/009:17:300
12155991716,1cyclictest161rcuc/010:12:070
12155991715,2cyclictest0-21swapper/011:26:370
12155991714,2cyclictest5809-21diskmemload11:45:150
12155991711,3cyclictest13-21ksoftirqd/012:19:250
1216599162,13cyclictest0-21swapper/312:23:393
1216599160,1cyclictest0-21swapper/309:56:573
1216599160,15cyclictest0-21swapper/311:58:383
1216599160,0cyclictest0-21swapper/312:15:513
1216099162,2cyclictest31029-21taskset10:42:181
12160991614,1cyclictest0-21swapper/108:50:271
1216099160,1cyclictest0-21swapper/112:06:481
1216099160,1cyclictest0-21swapper/110:01:441
1215599164,9cyclictest0-21swapper/010:27:360
1215599163,6cyclictest29457-21unixbench_singl11:00:250
1215599162,7cyclictest17768-21munin-run10:35:000
12155991614,2cyclictest13-21ksoftirqd/011:55:570
12155991614,1cyclictest13-21ksoftirqd/009:27:240
12155991613,2cyclictest21720-21cat11:55:000
12155991613,2cyclictest21720-21cat11:55:000
1216599156,8cyclictest5809-21diskmemload09:49:153
1216599150,14cyclictest0-21swapper/311:06:563
1216299159,5cyclictest0-21swapper/211:53:432
1216299159,5cyclictest0-21swapper/211:53:432
1216299153,7cyclictest25141-21apache210:10:122
1216099150,2cyclictest0-21swapper/109:18:141
1216099150,1cyclictest0-21swapper/109:20:171
1216099150,14cyclictest0-21swapper/107:10:201
12155991513,1cyclictest0-21swapper/011:35:170
12155991512,2cyclictest5809-21diskmemload10:15:030
12155991512,2cyclictest5809-21diskmemload09:55:120
1216599148,3cyclictest455-21dbus-daemon07:39:593
12165991411,2cyclictest301-21munin-run10:05:003
1216599140,1cyclictest0-21swapper/312:01:073
1216299149,4cyclictest24022-21/usr/sbin/munin12:35:272
1216299149,3cyclictest28827-21tr08:50:152
1216299148,5cyclictest8439-21chrt11:46:162
1216299142,7cyclictest25151-21cups-browsed11:35:262
12162991412,2cyclictest32-21ksoftirqd/209:20:142
12162991412,2cyclictest0-21swapper/211:30:532
12162991410,2cyclictest14603-21wc07:15:002
1216299140,2cyclictest0-21swapper/210:54:192
12160991412,1cyclictest0-21swapper/110:52:421
12160991412,1cyclictest0-21swapper/110:33:111
1216099141,1cyclictest14355-21kworker/1:010:56:061
1216099140,1cyclictest0-21swapper/111:48:041
1215599148,4cyclictest5809-21diskmemload09:20:040
12155991411,2cyclictest19605-21grep07:25:150
12155991410,3cyclictest31440-21idleruntime-cro07:50:010
1215599140,8cyclictest19542-21idleruntime-cro11:15:010
1215599140,7cyclictest14104-21awk09:14:590
1215599140,2cyclictest0-21swapper/012:02:540
1215599140,13cyclictest8137-21taskset09:50:120
1216599134,2cyclictest22915-21apt-get09:20:133
12165991310,2cyclictest6398-21grep11:25:263
12165991310,2cyclictest16213-21tr08:25:143
1216599130,3cyclictest0-21swapper/308:50:143
1216299139,3cyclictest5758-21sed08:00:252
1216299139,3cyclictest5340-21grep11:25:172
1216299139,3cyclictest32725-21wc07:50:192
1216299139,3cyclictest24629-21wc12:15:252
1216299139,2cyclictest31380-21grep11:40:252
1216299138,4cyclictest772-21wc12:20:242
1216299135,8cyclictest0-21swapper/208:25:032
12162991310,3cyclictest0-21swapper/212:07:542
12162991310,2cyclictest734-21grep09:25:262
12162991310,2cyclictest6458-21basename09:10:152
12162991310,2cyclictest1998-21wc10:05:212
12162991310,2cyclictest12371-21taskset11:10:172
1216299130,13cyclictest0-21swapper/210:49:262
1216299130,13cyclictest0-21swapper/208:57:332
1216099135,1cyclictest225-21systemd-journal07:24:591
1216099133,7cyclictest1142-21runrttasks07:25:191
1216099130,1cyclictest0-21swapper/111:44:121
1216099130,13cyclictest0-21swapper/111:22:321
1215599139,3cyclictest796-21cron09:00:000
1215599139,1cyclictest5809-21diskmemload12:34:560
1215599138,4cyclictest12264-21needreboot08:15:200
1215599137,5cyclictest0-21swapper/012:10:200
1215599136,6cyclictest0-21swapper/007:55:160
1215599136,4cyclictest0-21swapper/011:41:090
1215599134,6cyclictest0-21swapper/012:21:370
1215599132,1cyclictest13719-21sh11:30:170
12155991312,1cyclictest0-21swapper/007:15:130
12155991310,2cyclictest22799-21grep07:30:160
1215599130,12cyclictest7409-21tr09:30:150
1216599129,2cyclictest8081-21grep08:05:273
1216599129,2cyclictest7224-21cut12:05:193
1216599129,2cyclictest7216-21grep09:10:193
1216599129,2cyclictest4393-21cat08:00:143
1216599129,2cyclictest24254-21grep08:40:193
1216599129,2cyclictest21339-21taskset07:26:153
1216599129,2cyclictest2020-21taskset10:05:213
1216599129,2cyclictest17209-21cat09:35:273
1216599129,2cyclictest16545-21sh12:10:273
1216599129,2cyclictest1560-21cat07:55:013
1216599129,2cyclictest11313-21expr10:50:153
1216599127,2cyclictest225-21systemd-journal10:35:013
1216599126,2cyclictest225-21systemd-journal09:00:003
1216599124,7cyclictest5809-21diskmemload11:00:063
12165991210,1cyclictest4435-21ssh10:45:273
1216599120,2cyclictest0-21swapper/309:42:583
1216599120,1cyclictest0-21swapper/307:40:143
1216299129,2cyclictest7512-21grep08:05:212
1216299129,2cyclictest5371-21head11:05:262
1216299129,2cyclictest4409-21grep09:05:182
1216299129,2cyclictest30832-21ssh11:20:362
1216299129,2cyclictest25617-21sed09:40:252
1216299129,2cyclictest22768-21cut07:30:162
1216299129,2cyclictest22395-21wc08:35:272
1216299128,4cyclictest0-21swapper/209:32:132
1216299128,3cyclictest26173-21basename10:40:002
1216299128,3cyclictest1227-21grep09:45:222
1216299126,3cyclictest225-21systemd-journal07:45:002
1216099129,2cyclictest5461-21rm10:46:101
1216099129,2cyclictest3302-21tail07:55:281
1216099129,2cyclictest1599-21date07:55:001
1216099129,2cyclictest15056-21cut07:15:141
1216099129,2cyclictest10781-21ssh09:50:571
1216099128,3cyclictest2239-21grep10:05:221
1216099120,2cyclictest0-21swapper/108:55:191
1216099120,11cyclictest0-21swapper/112:30:071
1215599129,2cyclictest4427-21grep09:05:180
1215599129,2cyclictest32391-21cut09:45:140
1215599129,2cyclictest29065-21turbostat.cron07:45:000
1215599126,6cyclictest0-21swapper/011:08:560
1215599123,6cyclictest0-21swapper/008:00:120
1215599123,5cyclictest225-21systemd-journal07:55:000
1215599122,4cyclictest0-21swapper/010:02:270
12155991210,1cyclictest5809-21diskmemload12:36:110
1216599119,2cyclictest21622-21expr11:35:173
1216599119,2cyclictest18790-21chrt12:31:163
1216599119,1cyclictest6758-21ls11:45:213
1216599119,1cyclictest3667-21basename09:05:123
1216599119,1cyclictest30056-21head07:45:173
1216599119,1cyclictest27818-21sed08:45:263
1216599119,1cyclictest22017-21mktemp07:30:013
1216599119,1cyclictest18490-21taskset08:30:013
1216599119,1cyclictest18490-21taskset08:30:013
1216599119,1cyclictest14483-21sh09:15:083
1216599119,1cyclictest11117-21date08:15:003
1216599118,2cyclictest26721-21ssh10:40:143
1216599118,2cyclictest10044-21ssh12:25:543
12165991110,1cyclictest15235-21grep08:20:253
1216599110,10cyclictest20884-21basename08:35:143
1216599110,10cyclictest1515-21cat09:00:123
1216599110,10cyclictest14407-21taskset07:14:043
1216299118,2cyclictest7161-21ssh12:25:002
1216299118,2cyclictest5428-21ssh10:26:502
1216299118,2cyclictest30358-21ssh12:00:102
1216299118,2cyclictest28736-21grep11:00:182
1216299118,2cyclictest28080-21taskset08:47:402
1216299118,2cyclictest27525-21ssh10:00:522
1216299118,2cyclictest25518-21ssh10:20:012
1216299118,2cyclictest20285-21ssh09:56:472
1216299118,2cyclictest19813-21tr07:25:152
1216299118,2cyclictest19276-21tail08:30:192
1216299118,2cyclictest19276-21tail08:30:182
1216299118,2cyclictest19205-21chrt07:24:212
1216299118,2cyclictest17227-21sh09:15:562
1216299118,2cyclictest15944-21ssh12:10:212
1216299118,2cyclictest15236-21ssh09:35:072
1216299117,3cyclictest16476-21grep07:15:262
1216299117,2cyclictest2999-21unixbench_singl09:00:252
1216299113,1cyclictest24457-21sed08:40:212
1216299110,10cyclictest26710-21basename10:40:142
1216099119,1cyclictest27816-21grep08:45:261
1216099119,1cyclictest253202sleep108:40:291
1216099119,1cyclictest25281-21grep07:35:151
1216099119,1cyclictest21060-21ssh11:35:111
1216099119,1cyclictest20950-21grep08:35:151
1216099119,1cyclictest19053-21sed08:30:181
1216099119,1cyclictest19053-21sed08:30:171
1216099119,1cyclictest15257-21grep08:20:251
1216099118,2cyclictest5939-21sed09:09:591
1216099118,2cyclictest2368-21wc09:00:191
1216099110,11cyclictest7057-21cut09:10:171
1215599119,1cyclictest5809-21diskmemload09:41:010
1215599118,2cyclictest8802-21grep12:25:190
1215599118,2cyclictest29295-21head08:50:180
1215599118,2cyclictest25712-21http08:45:010
1215599118,2cyclictest21151-21grep08:35:160
1215599117,3cyclictest9313-21sed08:10:150
1215599116,2cyclictest0-21swapper/011:20:170
12155991110,1cyclictest13-21ksoftirqd/009:04:150
1215599110,1cyclictest0-21swapper/008:23:360
1215599110,10cyclictest6405-21cat08:05:120
1216599109,1cyclictest19246-21taskset07:24:533
1216599107,2cyclictest1656-21apache_volume07:55:133
1216599100,10cyclictest166522sleep307:17:163
1216299108,1cyclictest310932sleep207:45:442
1216299108,1cyclictest15247-21unixbench_singl08:20:252
1216299107,2cyclictest8912-21basename08:10:142
1216299107,2cyclictest11309-21cut08:15:142
1216099108,1cyclictest8937-21grep08:10:141
1216099108,1cyclictest28951-21chrt07:43:431
1216099108,1cyclictest17633-21grep08:25:261
1216099107,2cyclictest4598-21sed08:00:141
1216099107,2cyclictest11476-21cat08:15:141
1216099100,10cyclictest7453-21grep08:05:211
1215599109,1cyclictest13-21ksoftirqd/008:46:550
1215599108,2cyclictest12575-21egrep07:10:140
1215599107,2cyclictest24750-21tr07:35:130
1215599104,6cyclictest0-21swapper/007:20:140
121629990,8cyclictest56550irq/124-enp0s3107:36:172
121559996,3cyclictest13-21ksoftirqd/008:30:160
121559996,3cyclictest13-21ksoftirqd/008:30:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional