You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 22:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Sat Dec 20, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1811529582,9sleep20-21swapper/207:06:382
1806629481,9sleep00-21swapper/007:06:000
1810428266,12sleep10-21swapper/107:06:291
1824127967,8sleep30-21swapper/307:08:163
1847299311,7cyclictest8867-21apt-get09:05:143
18467992827,1cyclictest0-21swapper/109:19:361
18465992522,2cyclictest13-21ksoftirqd/012:00:000
1847299240,2cyclictest0-21swapper/310:10:133
1847299240,17cyclictest0-21swapper/308:30:163
1846799230,21cyclictest7899-21grep11:15:271
1847299210,4cyclictest20382-21cut10:35:173
1847299204,1cyclictest18211-21latency10:30:203
1847299198,8cyclictest31257-21taskset08:42:033
1847299193,2cyclictest11553-21wget11:25:163
1847299180,3cyclictest26898-21needreboot09:40:233
1847099176,7cyclictest423-21apt-get12:10:132
1847099176,7cyclictest423-21apt-get12:10:122
1847299166,9cyclictest12118-21cron10:20:003
1847299166,9cyclictest12118-21cron10:20:003
1847299163,4cyclictest225-21systemd-journal12:25:013
1847299161,2cyclictest26997-21kernelversion07:25:233
18472991612,3cyclictest39-21ksoftirqd/309:35:143
1847299160,15cyclictest24607-21head11:50:263
1847299160,15cyclictest1435-21chrt11:05:123
1847299160,15cyclictest0-21swapper/307:50:143
1846799160,15cyclictest0-21swapper/109:35:151
1847299159,5cyclictest5150-21wc10:05:003
1847299159,5cyclictest22394-21tr08:25:153
1847299158,6cyclictest31728-21uname07:35:193
1847299156,8cyclictest14533-21munin-run10:25:003
1847299150,14cyclictest12158-21taskset08:02:023
1847299150,14cyclictest10161-21readlink11:20:233
1847299149,4cyclictest27448-21grep11:55:263
1847299149,4cyclictest15112-21grep08:10:153
1847299148,5cyclictest3871-21grep07:45:183
1847299148,5cyclictest32718-21wc12:10:013
1847299148,5cyclictest24024-21taskset10:44:093
1847299148,5cyclictest21255-21tr11:45:163
1847299148,5cyclictest11353-21tr12:30:243
1847299147,6cyclictest6159-21cat10:05:193
1847299147,6cyclictest28837-21taskset10:54:593
1847299147,6cyclictest2804-21taskset08:50:213
1847299146,7cyclictest31193-21taskset10:59:483
1847299146,7cyclictest24658-21tr10:45:153
1847299146,7cyclictest10141-21cut08:00:003
1847299143,4cyclictest225-21systemd-journal08:19:593
1847299141,1cyclictest11914-21grep09:10:183
18472991410,3cyclictest6740-21tr09:00:143
1847299140,5cyclictest0-21swapper/308:20:143
1847299140,5cyclictest0-21swapper/308:20:143
1847299140,13cyclictest5939-21cron11:15:003
1847299140,13cyclictest28930-21sed07:30:183
1847099149,4cyclictest15450-21grep09:15:272
18470991410,3cyclictest22642-21sed11:45:282
18470991410,2cyclictest23721-21grep07:20:162
1846799149,4cyclictest29126-21cut09:45:191
18467991411,2cyclictest24095-21cron10:45:011
18467991411,2cyclictest1219-21tail09:55:181
18467991410,3cyclictest29392-21grep12:00:221
18465991410,2cyclictest15894-21grep10:25:200
1846599140,8cyclictest23165-21perf09:35:000
1847299139,3cyclictest13755-21tail08:05:213
1847299138,4cyclictest29491-21which12:00:223
1847299138,4cyclictest15549-21chrt11:30:443
1847299137,5cyclictest9182-21cat12:25:273
1847299137,5cyclictest21400-21aten2_r7power_v07:15:153
1847299137,5cyclictest15990-21sort09:20:003
1847299136,6cyclictest864-21cut07:40:153
1847299136,6cyclictest25932-21wc07:25:003
1847299136,6cyclictest15027-21expr10:25:163
1847299133,2cyclictest19653-21wc09:25:213
1847299132,4cyclictest1715-21ps12:10:233
1847299132,4cyclictest1715-21ps12:10:233
1847299132,2cyclictest225-21systemd-journal08:40:013
1847299131,4cyclictest19178-21cut07:10:153
1847299131,3cyclictest31982-21cpuspeed_turbos08:45:163
1847299131,2cyclictest225-21systemd-journal11:44:593
1847299131,1cyclictest0-21swapper/309:50:213
18472991310,2cyclictest3570-21head12:15:173
18472991310,2cyclictest1278-21sed09:55:183
1847299130,3cyclictest225-21systemd-journal09:00:013
1847299130,0cyclictest0-21swapper/312:35:163
1847099139,3cyclictest28230-21grep08:35:242
1847099139,3cyclictest21208-21grep10:35:262
1847099139,2cyclictest9588-21grep11:20:172
1847099138,3cyclictest20917-21wc09:30:002
18470991311,1cyclictest0-21swapper/210:15:152
18470991311,1cyclictest0-21swapper/210:15:152
18470991310,2cyclictest6288-21cut11:15:142
18470991310,2cyclictest32159-21grep11:00:182
18470991310,2cyclictest29275-21grep09:45:202
18470991310,2cyclictest27286-21grep07:25:262
18470991310,2cyclictest21003-21cron07:14:592
18470991310,2cyclictest17042-21cat10:30:012
18470991310,2cyclictest16153-21cut08:10:222
1846799139,3cyclictest25855-21tr08:30:241
1846799139,3cyclictest2446-21grep08:50:191
18467991310,2cyclictest9501-21grep11:20:171
18467991310,2cyclictest3010-21cat11:05:261
18467991310,2cyclictest30059-21grep07:30:281
18467991310,2cyclictest23901-21grep08:25:281
18467991310,2cyclictest14332-21tail08:05:271
1846799130,3cyclictest0-21swapper/111:00:151
1846599139,3cyclictest7526-21grep10:10:010
1846599139,3cyclictest11629-21sed10:15:270
1846599139,3cyclictest11629-21sed10:15:260
1846599139,2cyclictest22137-21grep10:40:160
1846599139,2cyclictest121692sleep008:02:100
18465991310,2cyclictest6972-21wc07:50:260
18465991310,2cyclictest29412-21tr09:45:220
18465991310,2cyclictest25845-21grep08:30:240
18465991310,2cyclictest2430-21tail07:40:260
18465991310,2cyclictest17832-21grep11:35:280
18465991310,2cyclictest1470-21awk08:50:010
1846599130,12cyclictest9938-21wc10:15:010
1846599130,11cyclictest8141-21tail09:00:260
1846599130,11cyclictest7855-21tail11:15:270
1847299129,2cyclictest16196-21grep11:35:163
1847299126,5cyclictest21075-21tr09:30:153
1847299126,5cyclictest16456-21cut09:20:163
1847299123,2cyclictest31591-21basename11:00:153
1847299121,2cyclictest225-21systemd-journal09:48:103
1847099129,2cyclictest8897-21grep09:05:142
1847099129,2cyclictest7241-21sed09:00:162
1847099129,2cyclictest4640-21df08:55:172
1847099129,2cyclictest30528-21cron07:35:002
1847099129,2cyclictest27350-21sed11:55:252
1847099129,2cyclictest27015-21tr10:50:152
1847099129,2cyclictest26083-21grep09:40:182
1847099129,2cyclictest19113-21df11:40:182
1847099129,2cyclictest11519-21grep08:00:232
1847099128,3cyclictest19368-21grep10:35:012
18470991211,1cyclictest0-21swapper/210:40:152
1847099120,11cyclictest9503-21grep07:55:272
1846799129,2cyclictest7749-21cut10:10:141
1846799129,2cyclictest7211-21sed07:50:271
1846799129,2cyclictest7194-21tail09:00:161
1846799129,2cyclictest5491-21sed11:10:261
1846799129,2cyclictest27835-21cron12:00:001
1846799129,2cyclictest21572-21sed08:20:271
1846799129,2cyclictest21572-21sed08:20:271
1846799129,2cyclictest19413-21sed09:25:191
1846799129,2cyclictest13093-21grep10:20:191
1846799129,2cyclictest12164-21tr10:20:001
1846799129,2cyclictest12164-21tr10:19:591
1846799128,3cyclictest15897-21awk11:34:591
1846799123,5cyclictest225-21systemd-journal12:20:011
1846799120,0cyclictest0-21swapper/107:15:131
1846599129,2cyclictest9950-21grep09:05:210
1846599129,2cyclictest5707-21sed08:55:270
1846599129,2cyclictest28099-21grep08:35:220
1846599129,2cyclictest26968-21tr10:50:150
1846599129,2cyclictest24603-21grep10:45:150
1846599129,2cyclictest2426-21grep08:50:190
1846599129,2cyclictest21323-21cat08:20:260
1846599129,2cyclictest21323-21cat08:20:250
1846599129,2cyclictest21230-21grep11:45:150
1846599129,2cyclictest2044-21wc09:55:270
1846599129,2cyclictest18576-21cat08:15:200
1846599128,3cyclictest3802-21cut07:45:180
1846599128,3cyclictest25034-21tail11:50:300
1846599128,3cyclictest21931-21grep07:15:170
1846599128,3cyclictest11692-21grep11:25:170
1846599128,2cyclictest5538-21wc12:20:180
1846599128,2cyclictest24744-21wc07:20:210
1846599124,4cyclictest225-21systemd-journal11:05:000
1846599121,6cyclictest4981-21tr12:20:010
18465991210,1cyclictest17508-21grep09:20:230
1847299112,2cyclictest6440-21grep11:15:153
1847099119,1cyclictest8384-21head10:10:172
1847099119,1cyclictest4122-21grep10:00:212
1847099118,2cyclictest9537-21taskset12:27:542
1847099118,2cyclictest6328-21grep12:20:242
1847099118,2cyclictest567-21grep07:40:002
1847099118,2cyclictest32207-21sed12:05:252
1847099118,2cyclictest30799-21grep09:50:182
1847099118,2cyclictest29882-21grep08:40:142
1847099118,2cyclictest29326-21ls12:00:212
1847099118,2cyclictest25757-21ntpq08:30:232
1847099118,2cyclictest25044-21grep10:45:172
1847099118,2cyclictest19833-21taskset08:20:012
1847099118,2cyclictest19833-21taskset08:20:012
1847099118,2cyclictest18033-21taskset09:20:332
1847099118,2cyclictest17884-21expr08:15:152
1847099118,2cyclictest1513-21head07:40:182
1847099118,2cyclictest14557-21sed11:30:172
1847099118,2cyclictest13539-21ntpq10:20:222
1847099118,2cyclictest1203-21grep09:55:182
1847099118,2cyclictest11670-21expr09:10:162
1847099118,2cyclictest11463-21cat12:30:272
1847099118,2cyclictest11415-21chrt11:25:142
1847099117,3cyclictest7147-21grep07:50:262
1847099115,2cyclictest225-21systemd-journal08:09:592
1847099113,4cyclictest225-21systemd-journal07:50:002
18470991110,1cyclictest32-21ksoftirqd/211:05:132
1846799119,1cyclictest23826-21tr07:20:161
1846799118,2cyclictest9904-21chrt07:58:541
1846799118,2cyclictest6879-21grep10:05:271
1846799118,2cyclictest5147-21taskset07:48:431
1846799118,2cyclictest437-21cron07:40:001
1846799118,2cyclictest31326-21idleruntime12:05:171
1846799118,2cyclictest28352-21grep10:50:261
1846799118,2cyclictest27701-21chrt09:42:281
1846799118,2cyclictest26309-21tr07:25:181
1846799118,2cyclictest2550-21taskset07:40:501
1846799118,2cyclictest24995-21grep11:50:301
1846799118,2cyclictest22683-21sed09:30:271
1846799118,2cyclictest16959-21expr09:20:171
1846799116,4cyclictest11434-21cut11:25:161
1846799113,4cyclictest225-21systemd-journal08:57:591
1846799110,10cyclictest12964-21cut12:35:191
1846599119,1cyclictest12804-21grep08:05:140
1846599118,2cyclictest9536-21tail07:55:270
1846599118,2cyclictest31058-21tr07:35:160
1846599118,2cyclictest31043-21sed08:40:260
1846599118,2cyclictest23971-21head08:25:280
1846599118,2cyclictest23464-21chrt09:35:130
1846599118,2cyclictest19394-21sed11:40:190
1846599118,2cyclictest18804-21grep09:25:160
1846599118,2cyclictest1723-21wc12:10:230
1846599118,2cyclictest1723-21wc12:10:230
1846599118,2cyclictest14912-21grep09:15:200
1846599118,2cyclictest11087-21head12:30:220
1846599118,2cyclictest10488-21grep11:20:260
1846599117,3cyclictest29077-21grep07:30:190
1846599115,3cyclictest225-21systemd-journal11:10:170
1847099108,1cyclictest4153-21cstates11:10:152
1847099108,1cyclictest3493-21chrt08:50:522
1847099108,1cyclictest32532-21expr08:45:182
1847099108,1cyclictest24431-21ls11:50:242
1847099108,1cyclictest23606-21cat07:20:002
1847099108,1cyclictest13956-21grep12:35:282
1847099107,2cyclictest7206-21taskset10:07:562
1847099107,2cyclictest29156-21tr10:55:162
1847099107,2cyclictest25394-21chrt09:38:362
1847099107,2cyclictest22996-21chrt09:33:152
1847099107,2cyclictest22702-21taskset08:25:162
1847099107,2cyclictest18244-21taskset11:39:082
1846799108,1cyclictest470-21cut12:10:141
1846799108,1cyclictest470-21cut12:10:131
1846799108,1cyclictest29745-21sort10:55:191
1846799108,1cyclictest209162sleep107:13:541
1846799108,1cyclictest18955-21awk08:15:251
1846799108,1cyclictest17360-21wc10:30:161
1846799108,1cyclictest10811-21taskset09:08:091
1846799108,1cyclictest10255-21taskset08:00:091
1846799107,2cyclictest981-21sed08:45:271
1846799107,2cyclictest9746-21ls12:30:011
1846799107,2cyclictest7036-21taskset12:21:111
1846799107,2cyclictest4059-21sh10:00:221
1846799107,2cyclictest27268-21cut08:35:171
1846799107,2cyclictest24380-21basename10:45:141
1846799107,2cyclictest20019-21expr10:35:161
1846799107,2cyclictest18759-21cut11:40:171
1846799107,2cyclictest16893-21sh10:30:011
1846799107,2cyclictest12301-21cat09:10:211
1846799107,2cyclictest10374-21expr12:30:171
1846799105,2cyclictest225-21systemd-journal09:54:591
1846799100,9cyclictest15415-21expr08:10:161
1846799100,0cyclictest0-21swapper/111:35:171
1846599108,1cyclictest9494-21taskset12:27:190
1846599108,1cyclictest4834-21chrt10:02:580
1846599108,1cyclictest2125-21cut11:05:160
1846599108,1cyclictest20626-21memory10:35:200
1846599108,1cyclictest144292sleep010:23:580
1846599108,1cyclictest137402sleep011:30:000
1846599108,1cyclictest12624-21cut12:35:160
1846599108,1cyclictest11336-21cut09:10:150
1846599107,2cyclictest31277-21grep09:50:200
1846599107,2cyclictest31131-21sort12:05:150
1846599107,2cyclictest30439-21find10:55:250
1846599107,2cyclictest29995-21taskset12:02:000
1846599107,2cyclictest26830-21grep07:25:200
1846599107,2cyclictest17999-21grep10:30:180
1846599107,2cyclictest16169-21taskset08:10:220
184709996,2cyclictest2942-21tr12:15:152
184679997,1cyclictest30590-21cut08:40:211
184679997,1cyclictest21209-21ls11:45:151
184659997,1cyclictest25815-21aten2_r7power_c09:40:170
184659997,1cyclictest20815-21taskset07:12:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional