You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 16:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sun Sep 06, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
981429075,11sleep20-21swapper/207:05:362
984028962,9sleep30-21swapper/307:05:573
802828963,8sleep00-21swapper/007:05:080
887927564,6sleep10-21swapper/107:05:181
10248992622,3cyclictest0-21swapper/311:05:233
1024899262,1cyclictest0-21swapper/309:37:363
10248992612,1cyclictest0-21swapper/310:38:073
10248992523,1cyclictest2826-21diskmemload12:32:123
10248992517,7cyclictest2826-21diskmemload12:25:223
10248992422,1cyclictest8293-21latency_hist10:50:003
10248992418,1cyclictest2826-21diskmemload09:21:173
10248992411,2cyclictest0-21swapper/310:05:283
10248992322,1cyclictest0-21swapper/311:22:383
10248992318,2cyclictest2826-21diskmemload10:32:593
10248992317,6cyclictest0-21swapper/312:05:063
10248992317,5cyclictest17557-21ntpq08:30:193
10248992316,6cyclictest2826-21diskmemload12:19:413
1024899230,1cyclictest0-21swapper/312:01:273
1024599230,23cyclictest0-21swapper/212:14:542
1024599230,23cyclictest0-21swapper/212:06:542
1024899225,5cyclictest0-21swapper/310:40:293
10248992221,0cyclictest2826-21diskmemload11:47:513
10248992220,1cyclictest1142-21runrttasks11:35:283
10248992216,5cyclictest0-21swapper/311:00:313
1024899220,1cyclictest0-21swapper/311:50:263
1024899220,1cyclictest0-21swapper/310:23:063
1024899220,1cyclictest0-21swapper/310:11:473
1024599220,21cyclictest0-21swapper/211:26:172
10243992221,1cyclictest0-21swapper/110:35:041
10238992219,2cyclictest0-21swapper/008:35:000
10248992120,0cyclictest2826-21diskmemload12:39:143
10248992119,2cyclictest2826-21diskmemload10:58:453
10248992119,1cyclictest2826-21diskmemload09:33:283
10248992118,2cyclictest0-21swapper/311:55:133
10248992117,2cyclictest0-21swapper/309:49:213
10248992115,1cyclictest0-21swapper/308:55:153
1024599210,21cyclictest0-21swapper/211:02:422
1024399210,19cyclictest0-21swapper/111:19:271
219132200,2sleep125-21ksoftirqd/110:00:081
10248992018,1cyclictest19283-21df_abs08:35:183
10245992019,1cyclictest0-21swapper/210:58:462
1024399204,9cyclictest38150irq/131-snd_hda11:10:131
1024399202,17cyclictest21019-21cat09:20:191
10248991918,1cyclictest0-21swapper/311:18:173
10248991917,1cyclictest3864-21apt-key09:30:013
10248991917,1cyclictest0-21swapper/311:32:493
10248991916,2cyclictest0-21swapper/309:55:133
10248991913,4cyclictest0-21swapper/309:44:113
1024899190,1cyclictest0-21swapper/312:13:473
1024899190,19cyclictest0-21swapper/310:28:243
1024599190,18cyclictest0-21swapper/209:24:142
1023899192,16cyclictest0-21swapper/009:00:120
10248991816,2cyclictest0-21swapper/308:00:143
10248991816,1cyclictest2826-21diskmemload10:03:543
10248991815,2cyclictest6216-21grep08:05:263
10248991813,1cyclictest2826-21diskmemload10:50:313
10248991810,3cyclictest0-21swapper/312:20:003
1024599180,1cyclictest0-21swapper/210:10:522
10243991815,2cyclictest25040-21ls11:00:011
1023899180,3cyclictest0-21swapper/009:28:380
1023899180,13cyclictest0-21swapper/011:50:130
10248991715,1cyclictest8675-21sh09:51:283
10248991715,1cyclictest2826-21diskmemload10:17:523
10248991714,2cyclictest0-21swapper/308:45:143
10248991713,3cyclictest0-21swapper/308:10:143
10248991710,7cyclictest0-21swapper/311:25:183
1024599172,11cyclictest22200-21taskset11:17:042
10245991717,0cyclictest0-21swapper/208:40:162
10245991716,1cyclictest0-21swapper/212:03:582
10245991711,5cyclictest32-21ksoftirqd/210:41:162
1024599170,14cyclictest0-21swapper/209:30:512
1023899172,4cyclictest0-21swapper/009:45:140
1023899171,10cyclictest0-21swapper/010:00:130
10248991614,1cyclictest0-21swapper/311:40:153
10248991613,3cyclictest2826-21diskmemload09:13:223
10248991611,2cyclictest0-21swapper/311:15:003
1024599160,14cyclictest0-21swapper/209:13:222
1024399162,13cyclictest29232-21ssh09:25:171
1024399160,16cyclictest0-21swapper/110:53:191
1024399160,15cyclictest0-21swapper/111:48:571
1023899163,6cyclictest16169-21awk08:29:590
10248991513,1cyclictest2826-21diskmemload09:17:433
10248991512,1cyclictest21631-21switchtime07:30:233
10248991511,3cyclictest0-21swapper/307:20:143
1024599152,8cyclictest19972-21apt-config11:54:592
1024599152,8cyclictest19407-21latency_hist09:20:012
10245991510,3cyclictest31237-21wc12:20:192
1024599150,15cyclictest0-21swapper/209:35:402
1024399150,2cyclictest0-21swapper/110:45:501
1023899154,10cyclictest516-21gdbus11:05:230
1023899152,7cyclictest10338-21sh11:30:000
1023899152,7cyclictest0-21swapper/011:10:140
1023899151,1cyclictest141rcu_preempt11:42:210
1024899143,4cyclictest225-21systemd-journal08:16:103
10245991414,0cyclictest0-21swapper/211:55:252
1024599141,10cyclictest0-21swapper/207:30:122
10245991410,3cyclictest29008-21tail07:45:252
1024599140,9cyclictest0-21swapper/211:10:132
1024599140,2cyclictest0-21swapper/212:35:082
1024599140,14cyclictest0-21swapper/210:05:412
1024399147,3cyclictest225-21systemd-journal12:01:081
10243991413,1cyclictest38150irq/131-snd_hda11:30:421
10243991412,1cyclictest0-21swapper/108:30:191
10243991410,3cyclictest30744-21tr10:05:141
1024399140,2cyclictest0-21swapper/111:40:001
1024399140,1cyclictest1518-21ssh09:47:221
1024399140,14cyclictest0-21swapper/110:11:161
1023899142,6cyclictest13210-21awk09:55:010
10238991410,3cyclictest23792-21dpkg10:40:000
10238991410,3cyclictest110732sleep011:49:410
1023899140,3cyclictest0-21swapper/011:03:200
1024899138,3cyclictest0-21swapper/307:10:103
1024899137,5cyclictest0-21swapper/309:05:013
1024899136,3cyclictest14013-21/usr/sbin/munin08:25:193
10248991310,2cyclictest29352-21chrt07:48:433
10248991310,2cyclictest24289-21sed07:35:263
1024599139,3cyclictest28436-21grep11:20:262
1024599139,3cyclictest24704-21sendmail07:40:002
1024599139,3cyclictest20838-21sort11:35:252
10245991310,2cyclictest11234-21grep07:10:152
1024599130,13cyclictest0-21swapper/212:28:232
1024599130,13cyclictest0-21swapper/210:49:512
1024399135,7cyclictest0-21swapper/112:25:011
1024399135,4cyclictest225-21systemd-journal08:05:001
1024399134,1cyclictest29996-21cups-browsed12:20:221
1024399131,8cyclictest2462-21apt-get11:25:111
10243991310,2cyclictest7660-21head08:10:151
10243991310,2cyclictest5972-21ssh09:50:161
10243991310,2cyclictest5832-21head09:30:231
10243991310,2cyclictest5750-21grep08:05:221
10243991310,2cyclictest27020-21tail08:50:191
10243991310,2cyclictest23741-21cut10:20:151
10243991310,2cyclictest16780-21seq09:17:571
1023899139,3cyclictest23769-21grep10:20:160
1023899139,3cyclictest1596-21tr10:45:210
10238991310,2cyclictest5283-21head09:30:180
10238991310,2cyclictest13918-21dump-pmu-power12:29:590
1024899129,2cyclictest29800-21grep07:50:143
1024899129,2cyclictest26202-21grep08:50:143
1024899128,3cyclictest1142-21runrttasks07:40:193
1024899122,9cyclictest1842-21awk09:05:213
1024599129,2cyclictest6225-21head09:50:182
1024599129,2cyclictest32200-21cut07:55:142
1024599129,2cyclictest3196-21cron11:45:012
1024599129,2cyclictest31496-21grep09:00:172
1024599129,2cyclictest29993-21wc09:25:242
1024599129,2cyclictest24969-21grep10:20:252
1024599129,2cyclictest24691-21tr08:45:192
1024599129,2cyclictest23761-21date10:40:002
1024599129,2cyclictest23064-21grep12:15:222
1024599129,2cyclictest188922sleep209:57:572
1024599129,2cyclictest16873-21grep07:20:262
1024599129,2cyclictest16670-21tr08:30:142
1024599129,2cyclictest16167-21wc10:15:222
1024599129,2cyclictest10936-21chrt11:49:332
1024599120,0cyclictest0-21swapper/212:32:352
1024599120,0cyclictest0-21swapper/209:46:132
1024399129,2cyclictest31397-21grep07:50:251
1024399129,2cyclictest24739-21grep12:35:291
1024399129,2cyclictest2441-21ssh11:05:191
1024399129,2cyclictest21980-21grep11:55:231
1024399129,2cyclictest21432-21grep09:40:151
1024399129,2cyclictest18315-21ssh09:57:301
1024399129,2cyclictest15093-21sort12:30:171
1024399129,2cyclictest14828-21fgrep12:10:221
1024399128,3cyclictest13816-21ssh10:33:571
1024399128,3cyclictest12156-21sed07:10:261
1024399128,2cyclictest9905-21tune2fs08:15:161
1024399127,1cyclictest27980-21fschecks_count07:45:161
1024399120,8cyclictest0-21swapper/107:35:121
1024399120,12cyclictest0-21swapper/112:15:391
1023899129,2cyclictest32042-21cat07:55:000
1023899129,2cyclictest32022-21sed12:20:270
1023899129,2cyclictest24687-21cron07:40:000
1023899129,2cyclictest21536-21readlink10:00:010
1023899129,2cyclictest20049-21rm11:35:170
1023899129,2cyclictest19338-21grep11:15:180
1023899129,2cyclictest18748-21grep10:55:250
1023899129,2cyclictest15689-21tr12:30:200
1023899129,2cyclictest14177-21cron10:14:590
1023899129,2cyclictest11426-21lockfile-create08:20:000
1023899128,3cyclictest6819-21sed12:05:260
1023899124,4cyclictest225-21systemd-journal09:15:000
1023899122,3cyclictest13778-21idleruntime-cro08:25:000
1024899119,1cyclictest0-21swapper/307:15:223
1024899118,2cyclictest11738-21grep08:20:123
1024899117,3cyclictest19542-21sed07:25:263
1024899113,5cyclictest1630-21taskset07:57:203
1024599118,2cyclictest6001-21ssh10:29:222
1024599118,2cyclictest5264-21sed08:05:172
1024599118,2cyclictest30558-21sed07:50:172
1024599118,2cyclictest30088-21head08:55:282
1024599118,2cyclictest26550-21grep08:50:162
1024599118,2cyclictest23558-21ssh09:40:472
1024599118,2cyclictest18897-21grep08:35:162
1024599118,2cyclictest14880-21ssh11:32:042
1024599118,2cyclictest1473-21cut11:05:142
1024599118,2cyclictest14186-21awk07:15:232
1024599118,2cyclictest12319-21sort08:20:152
1024599118,2cyclictest1133-21expr09:05:162
1024599117,3cyclictest8147-21cut10:30:172
1024599117,3cyclictest27255-21chrt10:02:582
1024599116,5cyclictest1035-21packagekitd08:02:482
1024599115,5cyclictest2826-21diskmemload10:50:522
1024599110,10cyclictest14164-21cut08:25:142
1024399119,1cyclictest28570-21tail11:40:181
1024399118,2cyclictest5548-21sh09:10:361
1024399118,2cyclictest3438-21ssh10:27:211
1024399118,2cyclictest29181-21cat08:55:201
1024399118,2cyclictest28972-21rm10:42:311
1024399118,2cyclictest27945-21wc11:20:231
1024399118,2cyclictest22444-21ps08:40:231
1024399118,2cyclictest20446-21tr07:30:131
1024399118,2cyclictest19713-21sh10:17:491
1024399118,2cyclictest17980-21tr07:25:131
1024399118,2cyclictest17163-21chrt07:22:381
1024399118,2cyclictest13345-21df07:15:171
1024399118,2cyclictest13133-21cat11:50:181
1024399118,2cyclictest10520-21ssh12:08:151
1024399112,2cyclictest225-21systemd-journal11:04:331
1024399110,10cyclictest23520-21sshd08:45:071
1024399110,10cyclictest12803-21chrt08:20:201
1024399110,0cyclictest0-21swapper/109:36:011
1023899118,2cyclictest9801-21ssh10:50:180
1023899118,2cyclictest9151-21cat10:30:260
1023899118,2cyclictest31524-21ls10:05:190
1023899118,2cyclictest31469-21grep10:25:120
1023899118,2cyclictest31084-21ssh12:00:300
1023899118,2cyclictest29203-21if_err_enp2s008:55:210
1023899118,2cyclictest27613-21grep08:50:260
1023899118,2cyclictest23335-21ssh09:40:370
1023899118,2cyclictest22066-21ssh09:20:320
1023899118,2cyclictest21954-21cut11:55:230
1023899118,2cyclictest21380-21sh12:15:000
1023899118,2cyclictest21023-21wc08:39:590
1023899118,2cyclictest18145-21ssh10:16:330
1023899118,2cyclictest17476-21apt-config07:25:010
1023899118,2cyclictest1603-21if_err_enp0s31f09:05:200
1023899118,2cyclictest15298-21ssh09:35:510
1023899118,2cyclictest13221-21cat07:15:150
1023899118,2cyclictest12749-21sed11:30:260
1023899118,2cyclictest12273-21forks09:15:170
1023899118,2cyclictest11245-21head07:10:160
1023899117,3cyclictest23281-21cron08:45:000
1023899110,10cyclictest30614-21ssh10:43:450
1024899107,2cyclictest21935-21sed08:40:173
1024599108,1cyclictest9477-21ls08:15:142
1024599108,1cyclictest8974-21taskset08:14:522
1024599108,1cyclictest25771-21tail07:40:182
1024599107,2cyclictest18629-21sh07:25:162
1024399108,1cyclictest32288-21aten2_r7power_v07:55:151
1024399108,1cyclictest26052-21cat07:40:211
1024399108,1cyclictest20094-21uname08:35:241
1024399107,2cyclictest31424-21tune2fs09:00:151
1024399107,2cyclictest2279-21sed09:05:271
1024399107,2cyclictest14067-21basename08:25:131
1023899108,1cyclictest26233-21ssh11:20:020
1023899108,1cyclictest23114-21expr12:35:170
1023899108,1cyclictest17721-21taskset07:25:000
1023899107,2cyclictest6100-21cat08:05:260
1023899107,2cyclictest28322-21sort07:45:190
1023899107,2cyclictest26148-21open_files07:40:210
1023899107,2cyclictest13098-21ssh12:10:030
1023899105,0cyclictest0-21swapper/008:10:230
1023899104,5cyclictest2136-21apache_processe08:00:120
1023899100,3cyclictest0-21swapper/007:55:140
102389997,1cyclictest20271-21cut07:30:120
102389996,2cyclictest23860-21cat08:45:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional