You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 19:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Dec 22, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6218991087,72cyclictest0-21swapper/012:15:210
621899906,63cyclictest0-21swapper/009:50:120
621899906,63cyclictest0-21swapper/009:50:120
621899816,23cyclictest0-21swapper/010:00:200
6219997516,13cyclictest7750irq/56-dwc_otg10:15:191
621899731,15cyclictest0-21swapper/007:40:200
6218997119,30cyclictest9339-21tail08:45:340
6218996811,11cyclictest0-21swapper/011:40:180
6220996611,4cyclictest20021-21tr12:20:162
621899643,10cyclictest0-21swapper/012:35:190
622099638,10cyclictest0-21swapper/208:05:192
621899637,44cyclictest0-21swapper/007:45:230
58952633,11sleep30-21swapper/307:09:233
58952633,11sleep30-21swapper/307:09:233
622099621,3cyclictest7850irq/56-dwc_otg_10:55:212
621899622,35cyclictest0-21swapper/008:35:200
621899621,39cyclictest16527-21unixbench_multi09:05:340
621899621,39cyclictest16527-21unixbench_multi09:05:340
6218996211,13cyclictest0-21swapper/010:30:180
71742610,3sleep20-21swapper/207:10:342
622099612,9cyclictest0-21swapper/211:50:202
621899611,14cyclictest29119-21unixbench_multi08:10:350
622199601,51cyclictest0-21swapper/307:40:203
6218996021,30cyclictest0-21swapper/009:10:180
6218996021,30cyclictest0-21swapper/009:10:180
622099591,5cyclictest23589-21timerandwakeup09:25:342
622199586,22cyclictest0-21swapper/308:25:193
6221995822,15cyclictest26856-21ls08:05:283
6220995820,26cyclictest0-21swapper/211:25:242
622099581,3cyclictest7850irq/56-dwc_otg_08:50:222
621899581,7cyclictest31451-21apt-get09:50:060
621899581,33cyclictest12058-21wget10:25:220
622099572,6cyclictest0-21swapper/209:06:292
622099572,6cyclictest0-21swapper/209:06:292
622099571,4cyclictest7950irq/56-dwc_otg_07:54:552
622099562,4cyclictest0-21swapper/212:25:212
622099561,3cyclictest7950irq/56-dwc_otg_09:55:302
622099561,3cyclictest7950irq/56-dwc_otg_09:50:232
622099561,3cyclictest7950irq/56-dwc_otg_09:50:232
6218995618,22cyclictest15064-21grep12:00:360
622099551,9cyclictest7950irq/56-dwc_otg_09:20:312
622099551,9cyclictest7850irq/56-dwc_otg_10:25:232
622099551,5cyclictest29751-21latency_hist08:15:072
621899551,32cyclictest4867-21aten_rbpower_vo10:05:210
6218995511,10cyclictest128-21systemd-journal09:25:060
622099544,12cyclictest7950irq/56-dwc_otg_08:29:242
622099542,4cyclictest24190-21modprobe08:00:062
6218995433,11cyclictest0-21swapper/007:13:000
6218995427,14cyclictest7950irq/56-dwc_otg_10:45:350
621899542,34cyclictest0-21swapper/007:15:200
622199533,10cyclictest7850irq/56-dwc_otg_12:35:213
622099531,3cyclictest7950irq/56-dwc_otg_09:31:232
6220995312,5cyclictest30277-21cpu11:15:222
622099531,13cyclictest0-21swapper/210:19:512
621999537,13cyclictest0-21swapper/108:20:201
621899536,44cyclictest0-21swapper/012:25:200
621899534,9cyclictest101ktimersoftd/009:55:180
6218995331,5cyclictest25624-21unixbench_singl09:30:360
621899531,31cyclictest0-21swapper/011:25:170
622099523,5cyclictest7950irq/56-dwc_otg_08:45:202
622099521,6cyclictest26778-21sed09:35:242
621999524,15cyclictest11612-21kworker/u8:009:50:171
621999524,15cyclictest11612-21kworker/u8:009:50:171
6218995212,18cyclictest0-21swapper/009:15:210
622199518,10cyclictest7950irq/56-dwc_otg_10:25:203
622099513,8cyclictest7850irq/56-dwc_otg_08:18:262
622099513,8cyclictest7850irq/56-dwc_otg_08:18:262
622099512,9cyclictest30018-21grep11:15:072
622099511,5cyclictest16114-21if_eth010:35:252
622099511,3cyclictest7750irq/56-dwc_otg11:35:362
6218995126,5cyclictest24974-21fschecks_count11:00:230
6218995123,8cyclictest27762-21cron08:10:060
621899511,30cyclictest0-21swapper/009:40:070
6221995012,14cyclictest23973-21ls10:55:353
622099507,5cyclictest0-21swapper/209:40:352
622099506,6cyclictest9963-21aten_rbpower_po07:20:222
622099501,5cyclictest0-21swapper/209:15:232
6220995010,6cyclictest11843-21aten_rbpower_cu08:55:212
6219995030,8cyclictest23-21ksoftirqd/110:55:191
621999502,6cyclictest7950irq/56-dwc_otg_09:25:211
6219995011,24cyclictest0-21swapper/111:05:211
622099492,6cyclictest7850irq/56-dwc_otg_11:03:332
622099491,5cyclictest24784-21sshd08:00:252
622099491,5cyclictest0-21swapper/207:44:462
622099491,4cyclictest7950irq/56-dwc_otg_11:20:202
622099491,3cyclictest7850irq/56-dwc_otg_11:55:312
6220994911,4cyclictest5556-21timerandwakeup08:35:362
6220994911,4cyclictest18628-21unixbench_multi10:40:362
6220994911,4cyclictest131062chrt07:28:332
6220994910,6cyclictest16423-21basename12:10:202
621999497,27cyclictest0-21swapper/112:00:211
6218994921,5cyclictest6504-21aten_rbpower_po08:40:210
621899491,28cyclictest10099-21cron11:50:060
622099481,8cyclictest7950irq/56-dwc_otg_07:50:012
6220994815,31cyclictest301ktimersoftd/210:30:242
622099481,3cyclictest7950irq/56-dwc_otg_10:03:362
622099481,3cyclictest0-21swapper/210:07:592
6219994822,5cyclictest24184-21idleruntime-cro08:00:061
6218994827,6cyclictest28186-21cut09:40:210
6218994826,11cyclictest3649-21wc11:30:260
621899482,27cyclictest0-21swapper/010:55:250
6218994817,16cyclictest0-21swapper/007:50:200
6218994815,14cyclictest0-21swapper/007:35:160
621899481,4cyclictest17771-21cut10:40:240
6218994814,5cyclictest11986-21latency_hist11:55:070
622199477,25cyclictest0-21swapper/307:25:203
6221994711,12cyclictest11081-21unixbench-2d08:50:363
622099471,4cyclictest7850irq/56-dwc_otg_12:04:072
622099471,3cyclictest7750irq/56-dwc_otg07:35:182
622099471,3cyclictest0-21swapper/211:09:002
622099471,2cyclictest0-21swapper/208:20:262
622099471,12cyclictest0-21swapper/209:12:002
622099471,12cyclictest0-21swapper/209:12:002
621999472,7cyclictest7950irq/56-dwc_otg_11:45:211
6219994717,6cyclictest12155-21fschecks_time08:55:251
6218994723,5cyclictest7850irq/56-dwc_otg_07:30:360
6218994717,21cyclictest0-21swapper/011:14:240
6218994714,24cyclictest0-21swapper/009:00:440
621899471,28cyclictest11791-21aten_rbpower_vo07:25:210
621899471,28cyclictest10874-21runrttasks10:20:310
621899471,27cyclictest8143-21idleruntime-cro10:15:060
6221994610,18cyclictest23129-21kernelversion09:25:273
622099467,5cyclictest0-21swapper/212:30:342
622099467,27cyclictest0-21swapper/212:15:212
622099466,37cyclictest21441-21cut10:50:232
621899466,21cyclictest0-21swapper/009:25:400
6218994619,5cyclictest10590-21/usr/sbin/munin08:50:290
6218994618,19cyclictest0-21swapper/008:19:260
6218994618,19cyclictest0-21swapper/008:19:260
6218994617,16cyclictest0-21swapper/008:28:400
622199459,13cyclictest21006-21ls12:20:323
6221994522,6cyclictest15543-21aten_rbpower_vo09:05:213
6221994522,6cyclictest15543-21aten_rbpower_vo09:05:213
6221994515,12cyclictest11807-21latency_hist10:25:063
6221994511,14cyclictest12483-21fschecks_time11:55:243
622099457,35cyclictest25670-21cut12:35:252
622099457,26cyclictest0-21swapper/211:45:212
622099457,23cyclictest0-21swapper/210:10:192
622099452,3cyclictest0-21swapper/207:31:462
6218994532,4cyclictest7950irq/56-dwc_otg_11:35:200
6218994524,4cyclictest17268-21ls10:40:060
621899452,26cyclictest0-21swapper/012:20:230
6218994520,14cyclictest0-21swapper/012:31:230
6218994516,14cyclictest0-21swapper/008:23:220
6218994515,5cyclictest23681-21grep07:55:340
621899451,34cyclictest0-21swapper/011:20:230
6218994511,10cyclictest8972-21ls10:15:270
622199449,14cyclictest10096-21latency_hist10:20:073
622199448,18cyclictest7950irq/56-dwc_otg_07:50:063
622199448,14cyclictest396-21runrttasks08:21:013
622199447,23cyclictest0-21swapper/310:35:123
622199446,24cyclictest0-21swapper/309:00:203
622099447,35cyclictest8007-21ls08:45:062
6219994413,18cyclictest30462uniq08:30:241
6218994425,5cyclictest7850irq/56-dwc_otg_12:10:300
6218994418,14cyclictest1125-21runrttasks10:51:040
6218994413,19cyclictest13-21rcuc/008:55:390
621899441,20cyclictest0-21swapper/007:20:340
622199439,12cyclictest21077-21/usr/sbin/munin09:20:233
6221994310,17cyclictest13470-21cat09:00:073
622099434,4cyclictest7950irq/56-dwc_otg_11:30:512
622099431,9cyclictest0-21swapper/211:42:032
622099431,8cyclictest7950irq/56-dwc_otg_10:22:562
621999438,13cyclictest7850irq/56-dwc_otg_12:35:191
621999437,24cyclictest0-21swapper/112:30:221
621999436,23cyclictest0-21swapper/110:35:121
621999436,20cyclictest0-21swapper/109:20:201
621899435,21cyclictest128-21systemd-journal12:08:160
621899435,21cyclictest128-21systemd-journal12:08:160
621899432,6cyclictest13265-21grep11:55:350
621899431,22cyclictest3304-21latency08:30:270
621899431,14cyclictest0-21swapper/011:15:240
58752432,34sleep00-21swapper/007:09:080
58752432,34sleep00-21swapper/007:09:080
622199429,13cyclictest24509-21aten_rbpower_po08:00:213
622199427,13cyclictest28435-21if_eth008:10:263
6221994216,10cyclictest7850irq/56-dwc_otg_09:55:223
6221994210,13cyclictest14870-21unixbench-2d10:30:353
6220994211,20cyclictest7850irq/56-dwc_otg_09:00:272
621999425,9cyclictest7850irq/56-dwc_otg_11:15:191
622199417,23cyclictest0-21swapper/311:00:203
622199417,22cyclictest0-21swapper/309:10:203
622199417,22cyclictest0-21swapper/309:10:203
622199415,4cyclictest0-21swapper/310:50:173
6221994119,5cyclictest29064-21timerwakeupswit09:40:343
6221994114,12cyclictest2236-21/usr/sbin/munin11:25:323
622199411,16cyclictest0-21swapper/307:30:193
6221994110,9cyclictest31796-21apt-get09:50:173
6221994110,9cyclictest31796-21apt-get09:50:173
622199408,23cyclictest0-21swapper/310:40:213
622199404,23cyclictest0-21swapper/311:15:203
621999407,23cyclictest0-21swapper/108:00:201
621999401,26cyclictest11136-21timerandwakeup10:20:351
6218994014,7cyclictest26580-21aten_rbpower_cu11:05:210
621899401,23cyclictest0-21swapper/008:00:310
622199398,12cyclictest20888-21awk10:50:063
622199397,21cyclictest0-21swapper/307:15:223
622199392,12cyclictest17977-21basename12:15:063
621999396,23cyclictest0-21swapper/107:45:231
6219993917,5cyclictest6775-21aten_rbpower_cu11:40:211
621999391,2cyclictest0-21swapper/110:30:241
621999391,28cyclictest7116-21ls07:10:331
621999391,18cyclictest7750irq/56-dwc_otg12:15:061
622199389,18cyclictest16761-21taskset07:39:093
6221993824,11cyclictest25314-21latency_hist12:35:073
6221993815,13cyclictest5930-21sshd08:37:153
622199381,23cyclictest0-21swapper/309:15:203
6221993810,10cyclictest29868-21taskset11:14:433
621999381,21cyclictest13701-21ls10:30:071
622199377,16cyclictest7950irq/56-dwc_otg_10:10:333
622199376,23cyclictest0-21swapper/308:40:213
622199375,19cyclictest6421-21sshd11:39:163
622199373,20cyclictest7950irq/56-dwc_otg_08:45:163
6221993711,11cyclictest7950irq/56-dwc_otg_09:48:183
622199370,19cyclictest225852chrt07:55:113
622099371,14cyclictest0-21swapper/212:06:522
622099371,14cyclictest0-21swapper/212:06:522
621999377,15cyclictest7950irq/56-dwc_otg_07:20:211
621999371,25cyclictest0-21swapper/111:25:201
6219993710,9cyclictest17331-21uniq07:40:231
622199367,15cyclictest0-21swapper/312:25:203
622199364,13cyclictest31024-21taskset08:15:433
622199364,13cyclictest31024-21taskset08:15:433
622199362,13cyclictest27525-21taskset09:36:213
6221993617,10cyclictest7654-21sshd07:13:153
622199361,27cyclictest0-21swapper/311:33:463
621999361,23cyclictest15887-21ls07:35:261
622199355,12cyclictest16102-21taskset12:09:333
622199355,12cyclictest16102-21taskset12:09:333
622199355,12cyclictest0-21swapper/309:31:173
622199354,21cyclictest7850irq/56-dwc_otg_07:21:033
622199354,11cyclictest15431-21taskset12:04:013
622199353,7cyclictest0-21swapper/310:00:203
6221993511,15cyclictest381ktimersoftd/311:52:583
622099351,25cyclictest3069-21cut08:30:242
621999351,26cyclictest8126-21latency_hist10:15:071
621999351,24cyclictest31403-21latency_hist08:20:071
621999351,24cyclictest31403-21latency_hist08:20:071
621999351,20cyclictest19180-21ls10:45:061
622199347,14cyclictest0-21swapper/310:06:393
622199346,11cyclictest0-21swapper/311:45:213
6221993415,4cyclictest7850irq/56-dwc_otg_08:33:043
622099347,13cyclictest7850irq/56-dwc_otg_07:15:262
621999348,11cyclictest7950irq/56-dwc_otg_09:35:061
621999346,15cyclictest7750irq/56-dwc_otg11:20:341
621999342,7cyclictest16165-21idleruntime-cro12:10:061
621999342,7cyclictest16165-21idleruntime-cro12:10:061
622199333,17cyclictest19556-21taskset12:17:273
622199331,16cyclictest32242-21fschecks_count11:20:233
622099331,8cyclictest7950irq/56-dwc_otg_10:47:062
621999335,7cyclictest7750irq/56-dwc_otg09:45:241
621999334,10cyclictest0-21swapper/109:15:201
6219993313,4cyclictest13420-21latency_hist07:30:071
621999331,21cyclictest13742-21wget09:00:211
622199329,10cyclictest7950irq/56-dwc_otg_11:09:203
622199328,5cyclictest0-21swapper/311:41:583
622099321,9cyclictest0-21swapper/209:50:002
621999329,4cyclictest27175-21timerandwakeup08:05:341
621999328,11cyclictest7950irq/56-dwc_otg_11:00:341
621999325,10cyclictest7750irq/56-dwc_otg08:10:221
621999324,13cyclictest7950irq/56-dwc_otg_09:41:271
621999324,12cyclictest7850irq/56-dwc_otg_08:50:261
621999316,6cyclictest7850irq/56-dwc_otg_12:20:221
621999315,5cyclictest21817-21ntp_states10:50:291
621999311,6cyclictest7750irq/56-dwc_otg12:25:321
6219993114,4cyclictest4923-21/usr/sbin/munin11:35:251
6219993113,11cyclictest21-21rcuc/109:06:351
6219993113,11cyclictest21-21rcuc/109:06:351
621999311,14cyclictest7750irq/56-dwc_otg11:30:231
621999311,12cyclictest7750irq/56-dwc_otg12:15:251
621999309,6cyclictest1942950wget10:45:211
621999309,14cyclictest0-21swapper/109:55:291
621999306,4cyclictest7750irq/56-dwc_otg11:55:351
621999303,5cyclictest7750irq/56-dwc_otg08:50:061
622199293,11cyclictest22404-21cat07:55:063
621999297,6cyclictest7750irq/56-dwc_otg07:32:531
621999293,16cyclictest1125-21runrttasks08:41:001
621999292,3cyclictest7750irq/56-dwc_otg07:50:181
6219992922,4cyclictest1075-21aten_rbpower_po08:25:201
621999291,6cyclictest7950irq/56-dwc_otg_09:15:051
621999291,6cyclictest7950irq/56-dwc_otg_09:15:051
621999291,3cyclictest7750irq/56-dwc_otg10:05:191
621999291,19cyclictest0-21swapper/107:15:271
116272291,5sleep10-21swapper/111:51:371
621999281,7cyclictest29981-21latency_hist11:15:071
43372283,15sleep10-21swapper/107:05:081
43372283,15sleep10-21swapper/107:05:081
621999272,4cyclictest0-21swapper/109:35:201
621999271,14cyclictest0-21swapper/108:35:361
621999262,4cyclictest7750irq/56-dwc_otg10:00:251
57122264,14sleep20-21swapper/207:06:592
57122264,14sleep20-21swapper/207:06:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional