You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 15:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Wed Mar 18, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23884211510,7sleep00-21swapper/007:10:060
2284422890,2sleep20-21swapper/207:05:272
144832920,2sleep00-21swapper/009:23:260
224672800,1sleep30-21swapper/312:08:003
24033997939,16cyclictest24031-21cyclictest07:10:081
214472770,2sleep30-21swapper/309:30:423
36862760,2sleep20-21swapper/212:25:012
24032997643,9cyclictest7750irq/56-dwc_otg10:15:190
24032997225,8cyclictest0-21swapper/010:30:150
210402720,4sleep021043-21diskmemload09:30:310
24033997018,18cyclictest7950irq/56-dwc_otg_09:40:061
24032997017,33cyclictest15243-21fschecks_count11:20:220
2403399681,10cyclictest12475-21ssh12:35:111
2403299682,11cyclictest19835-21ssh12:05:170
27172660,2sleep00-21swapper/011:44:420
269452660,5sleep32403599cyclictest09:37:513
24034996619,31cyclictest0-21swapper/209:15:232
24033996619,29cyclictest56412cat09:50:311
2403399661,15cyclictest7950irq/56-dwc_otg_10:30:171
2403299669,21cyclictest7950irq/56-dwc_otg_07:10:080
24032996618,28cyclictest5007-21fschecks_time09:50:220
75192650,4sleep17522-21aten_rbpower_vo11:50:181
2403599655,5cyclictest7850irq/56-dwc_otg_11:30:273
24034996426,13cyclictest6691-21wget11:10:192
24034996426,13cyclictest6691-21wget11:10:192
24034996329,16cyclictest28307-21ls07:20:272
24034996329,15cyclictest24319-21fschecks_time12:10:232
24034996327,21cyclictest13958-21ssh11:18:552
24032996336,6cyclictest0-21swapper/007:20:160
24032996318,25cyclictest0-21swapper/009:45:050
237152631,54sleep10-21swapper/107:09:321
199582630,2sleep20-21swapper/209:30:092
2403599625,4cyclictest7850irq/56-dwc_otg_07:10:223
24034996230,16cyclictest13494-21/usr/sbin/munin12:35:312
24034996230,11cyclictest5749-21apt-get10:30:152
24034996229,21cyclictest26619-21ls10:15:352
24032996217,25cyclictest0-21swapper/012:25:260
24035996113,10cyclictest7656-21ssh09:53:313
24034996128,12cyclictest7972-21ssh11:50:242
24034996127,20cyclictest7950irq/56-dwc_otg_11:30:302
24033996122,17cyclictest24891-21grep08:40:231
24033996120,24cyclictest12544-21ssh11:16:231
24033996115,25cyclictest11524-21kworker/u8:311:25:061
202392610,1sleep10-21swapper/110:46:451
202392610,1sleep10-21swapper/110:46:451
24034996029,9cyclictest26432-21df08:45:212
24034996029,12cyclictest26062-21/usr/sbin/munin07:15:222
24034996024,11cyclictest12110-21ssh09:20:262
24033996020,21cyclictest7756-21ssh12:29:431
2403599596,4cyclictest0-21swapper/311:37:493
24034995923,11cyclictest24909-21/usr/sbin/munin08:40:242
24034995920,11cyclictest0-21swapper/210:35:292
24033995922,19cyclictest29741-21sh10:58:591
24033995916,14cyclictest26232-21/usr/sbin/munin10:15:301
24033995913,29cyclictest7750irq/56-dwc_otg10:02:011
2403299592,10cyclictest20205-21grep11:25:320
24032995914,22cyclictest3083-21grep11:05:240
24035995812,42cyclictest0-21swapper/307:15:213
24034995833,11cyclictest27330-21ssh09:38:312
24034995828,20cyclictest22027-21ssh10:50:032
24034995828,20cyclictest22027-21ssh10:50:032
24034995827,19cyclictest31685-21ssh09:43:422
24034995821,23cyclictest7723-21ssh12:29:402
24034995818,23cyclictest7950irq/56-dwc_otg_08:14:182
24034995818,23cyclictest7950irq/56-dwc_otg_08:14:182
24033995819,22cyclictest7989-21ssh11:10:361
24033995819,22cyclictest7989-21ssh11:10:361
2403299582,22cyclictest0-21swapper/009:45:170
2403299581,31cyclictest0-21swapper/010:20:320
2403299581,29cyclictest2196-21grep09:05:330
2403299581,29cyclictest0-21swapper/008:20:160
2403299581,28cyclictest0-21swapper/007:30:340
2403599573,9cyclictest7950irq/56-dwc_otg_11:25:313
24035995715,4cyclictest908-21runrttasks08:50:523
24034995729,19cyclictest5661-21ssh11:47:312
24034995727,12cyclictest13117-21ssh11:56:022
24034995725,16cyclictest2726-21ssh11:44:422
24034995724,11cyclictest7850irq/56-dwc_otg_07:10:192
24034995723,20cyclictest2057-21seq07:35:472
24034995723,20cyclictest2057-21seq07:35:472
24034995720,12cyclictest7750irq/56-dwc_otg11:24:462
24034995717,24cyclictest7950irq/56-dwc_otg_11:36:122
24034995717,23cyclictest7750irq/56-dwc_otg10:27:252
24033995716,24cyclictest22229-21ssh12:07:331
2403299577,31cyclictest0-21swapper/011:50:260
24032995721,24cyclictest0-21swapper/010:11:520
2403299570,54cyclictest32253-21kworker/0:210:35:150
231892570,17sleep37950irq/56-dwc_otg_10:50:303
139182570,2sleep30-21swapper/308:10:233
139182570,2sleep30-21swapper/308:10:233
2403599562,11cyclictest0-21swapper/307:38:413
2403599562,11cyclictest0-21swapper/307:38:413
24034995631,16cyclictest29588-21ssh10:58:432
24034995628,18cyclictest24078-21taskset10:13:002
24034995626,20cyclictest15627-21ssh10:41:032
24034995622,19cyclictest341-21/usr/sbin/munin09:45:322
24033995623,7cyclictest28587-21ls07:20:311
2403299562,20cyclictest28163-21aten_rbpower_cu12:15:200
160482560,1sleep00-21swapper/008:15:270
2403599553,13cyclictest7950irq/56-dwc_otg_09:40:333
2403599551,6cyclictest3199-21df_inode09:10:203
24035995516,4cyclictest908-21runrttasks10:40:323
2403599551,3cyclictest7750irq/56-dwc_otg12:35:193
2403599551,13cyclictest7950irq/56-dwc_otg_11:10:273
2403599551,13cyclictest7950irq/56-dwc_otg_11:10:273
24034995528,13cyclictest1713-21rm11:04:302
24034995525,13cyclictest5251-21ssh09:12:142
24034995524,12cyclictest21456-21ssh11:27:322
24033995521,16cyclictest17752-21ssh12:01:561
24033995519,20cyclictest26566-21ssh12:12:541
2403299558,10cyclictest0-21swapper/012:20:180
24032995530,4cyclictest7950irq/56-dwc_otg_12:10:230
24032995523,4cyclictest27388-21grep10:55:290
2403299552,34cyclictest0-21swapper/011:35:060
2403299552,31cyclictest3821-21head07:40:330
2403299552,30cyclictest0-21swapper/009:55:190
2403299552,27cyclictest0-21swapper/012:00:590
24032995516,3cyclictest0-21swapper/011:55:170
2403599549,4cyclictest0-21swapper/310:06:393
2403599543,9cyclictest7850irq/56-dwc_otg_12:01:183
2403599542,9cyclictest0-21swapper/311:20:233
2403599542,9cyclictest0-21swapper/311:03:383
24035995417,4cyclictest908-21runrttasks11:15:163
24035995416,4cyclictest2335-21sh11:43:593
24035995416,4cyclictest10059-21sh11:53:003
2403599541,4cyclictest15145-21rm09:24:353
24034995425,11cyclictest11996-21rm09:58:492
24034995424,10cyclictest7750irq/56-dwc_otg10:09:512
24034995422,19cyclictest149-21systemd-journal07:28:132
24034995421,10cyclictest7950irq/56-dwc_otg_10:02:022
24034995419,20cyclictest7950irq/56-dwc_otg_12:18:312
24033995424,17cyclictest21637-21ssh11:27:521
24033995423,13cyclictest10920-21/usr/sbin/munin10:35:321
24033995422,13cyclictest31556-21ssh09:43:281
24033995420,20cyclictest747-21ssh10:24:331
24033995416,13cyclictest26907-21ntpq08:45:281
24033995416,10cyclictest0-21swapper/110:50:171
24033995412,21cyclictest7950irq/56-dwc_otg_09:48:211
2403299544,27cyclictest25568-21grep09:35:340
24032995428,7cyclictest7850irq/56-dwc_otg_08:50:320
2403299542,30cyclictest29894-21aten_rbpower_en08:55:190
2403299541,34cyclictest11944-21timerwakeupswit11:15:330
24032995411,14cyclictest30064-21latency07:25:250
2403599536,4cyclictest7950irq/56-dwc_otg_12:25:293
2403599532,9cyclictest7950irq/56-dwc_otg_09:06:323
2403599532,5cyclictest3128-21ssh09:48:023
24034995323,13cyclictest17297-21ssh09:25:532
24034995321,20cyclictest7850irq/56-dwc_otg_08:58:502
24034995321,12cyclictest12138-21ssh12:35:062
24034995321,11cyclictest23735-21ssh12:10:062
24034995319,21cyclictest917-21snmpd07:43:162
24034995319,17cyclictest5008-21sh11:07:442
24034995319,11cyclictest7850irq/56-dwc_otg_10:52:532
2403399538,27cyclictest17266-21ssh09:25:501
24033995322,13cyclictest21852-21ssh09:31:231
24033995320,19cyclictest10204-1kworker/u9:210:07:211
24033995320,12cyclictest10020-21ssh09:18:041
24033995319,20cyclictest26192-21ssh11:33:361
24033995319,11cyclictest4055-21seq07:43:151
24033995315,21cyclictest12324-21awk09:20:301
24033995314,13cyclictest31906-21if_wlan007:30:241
24033995314,10cyclictest0-21swapper/112:32:281
2403299535,10cyclictest7750irq/56-dwc_otg08:45:170
24032995332,5cyclictest11836-21aten_rbpower_en08:05:180
2403299532,48cyclictest7264-21latency_hist11:50:060
2403299532,26cyclictest0-21swapper/010:30:070
2403299531,28cyclictest5622-21head07:45:330
24035995217,4cyclictest8912-21sh09:55:173
2403599521,5cyclictest3523-21ssh11:45:223
2403599521,4cyclictest32025-21rm10:22:233
2403599521,15cyclictest0-21swapper/312:30:093
24034995213,24cyclictest0-21swapper/208:18:022
24033995224,18cyclictest31304-21runrttasks08:59:061
24033995222,8cyclictest580-21kworker/u8:108:00:111
24033995221,22cyclictest5147-21ssh10:29:461
24033995219,13cyclictest29565-21/usr/sbin/munin07:25:331
2403299524,27cyclictest19698-21cron09:30:060
24032995224,13cyclictest7750irq/56-dwc_otg09:15:190
24032995222,4cyclictest27502-21aten_rbpower_cu11:35:190
24032995220,17cyclictest0-21swapper/008:30:270
2403299521,28cyclictest13272-21/usr/sbin/munin12:35:270
106492520,3sleep12403399cyclictest09:56:211
2403599517,12cyclictest7950irq/56-dwc_otg_10:30:063
2403599515,3cyclictest0-21swapper/309:25:553
2403599513,4cyclictest7850irq/56-dwc_otg_08:45:343
2403599512,3cyclictest0-21swapper/310:45:243
2403599512,3cyclictest0-21swapper/310:45:243
2403599511,5cyclictest27320-21sh10:16:223
2403599511,5cyclictest0-21swapper/312:18:463
24034995115,11cyclictest7850irq/56-dwc_otg_12:04:312
24033995122,11cyclictest14850-21ssh11:59:121
24033995120,13cyclictest1876-21seq07:35:301
24033995120,13cyclictest1876-21seq07:35:301
24033995115,10cyclictest7850irq/56-dwc_otg_11:47:581
24033995115,10cyclictest7850irq/56-dwc_otg_07:15:251
2403299513,30cyclictest0-21swapper/009:10:160
118732510,5sleep12403399cyclictest08:05:181
2403599507,3cyclictest0-21swapper/311:55:213
2403599504,4cyclictest7750irq/56-dwc_otg10:14:043
2403599502,4cyclictest0-21swapper/310:55:323
2403599501,6cyclictest4008-21rm11:05:543
2403599501,10cyclictest7950irq/56-dwc_otg_10:01:453
24034995022,11cyclictest514-21ssh10:24:072
24034995022,11cyclictest13215-21chrt08:08:372
24034995020,14cyclictest24187-21munin-run08:40:062
24034995019,11cyclictest29239-21taskset08:50:442
24033995023,17cyclictest22154-21sshd08:32:321
24033995023,15cyclictest2621-21diskmemload11:39:201
24033995019,11cyclictest3140-21ssh12:24:021
24033995017,11cyclictest17253-21rm10:44:031
24033995015,14cyclictest5442-21ssh09:12:341
2403299504,28cyclictest0-21swapper/007:35:310
2403299504,28cyclictest0-21swapper/007:35:310
24032995027,5cyclictest14366-21cut10:40:220
2403299501,23cyclictest0-21swapper/008:10:190
2403299501,23cyclictest0-21swapper/008:10:190
2403599491,4cyclictest10718-21open_inodes10:35:293
24034994921,16cyclictest7676-21seq07:53:222
24034994918,13cyclictest18511-21taskset08:22:032
24033994922,12cyclictest2901-21ssh11:45:021
24033994918,12cyclictest29450-21ssh12:15:371
24033994912,21cyclictest0-21swapper/111:04:321
2403299491,40cyclictest0-21swapper/010:54:180
2403299491,26cyclictest19176-21ssh10:45:300
2403299491,26cyclictest19176-21ssh10:45:300
2403599481,6cyclictest7750irq/56-dwc_otg12:20:223
2403599481,3cyclictest0-21swapper/310:33:093
24034994832,13cyclictest9251-21/usr/sbin/munin07:55:332
24034994821,17cyclictest20333-21taskset08:27:182
24034994821,16cyclictest7950irq/56-dwc_otg_08:03:192
24034994821,10cyclictest7850irq/56-dwc_otg_08:32:182
24034994819,15cyclictest7950irq/56-dwc_otg_09:10:032
24034994818,18cyclictest149-21systemd-journal07:48:172
24033994819,22cyclictest725-21sshd09:04:321
24033994819,22cyclictest725-21sshd09:04:321
24033994818,18cyclictest9314-21runrttasks07:56:121
24033994817,16cyclictest14847-21sshd08:11:321
24033994817,16cyclictest14847-21sshd08:11:321
24033994813,11cyclictest0-21swapper/108:19:251
2403299486,29cyclictest21122-21ls10:10:060
2403299481,36cyclictest0-21swapper/008:40:230
24032994810,20cyclictest0-21swapper/008:00:330
2403599477,3cyclictest7750irq/56-dwc_otg09:15:273
2403599475,3cyclictest0-21swapper/312:12:053
24034994724,10cyclictest6010-21ssh09:50:382
24033994719,7cyclictest5383-21ssh11:08:261
24033994716,11cyclictest21358-21ssh10:10:121
24033994710,12cyclictest917-21snmpd08:38:271
24032994725,6cyclictest7014-21fschecks_time11:10:230
24032994725,6cyclictest7014-21fschecks_time11:10:230
2403299472,34cyclictest0-21swapper/009:00:290
2403299472,34cyclictest0-21swapper/009:00:290
24032994714,5cyclictest26966-21unixbench_multi07:15:350
24032994714,16cyclictest908-21runrttasks12:34:520
2403299471,35cyclictest0-21swapper/010:04:050
2403399467,27cyclictest0-21swapper/108:25:191
24032994617,20cyclictest0-21swapper/007:59:310
24032994611,25cyclictest0-21swapper/008:35:180
24034994518,10cyclictest0-21swapper/207:31:072
24033994516,15cyclictest18723-21taskset08:24:451
2403299457,28cyclictest0-21swapper/007:50:200
2403599447,35cyclictest0-21swapper/308:00:313
24034994435,7cyclictest31639-21apt-get09:00:172
24034994435,7cyclictest31639-21apt-get09:00:172
24033994413,18cyclictest7483-21runrttasks07:50:521
24033994411,19cyclictest505-21rs:main1
24032994415,21cyclictest0-21swapper/008:28:090
2403299441,20cyclictest30730-21wget11:00:180
24033994322,8cyclictest5669-21taskset07:45:451
24033994125,13cyclictest28087-21aten_rbpower_en08:50:191
2403599407,30cyclictest0-21swapper/307:30:063
2403599401,4cyclictest0-21swapper/307:29:253
2403599386,5cyclictest7850irq/56-dwc_otg_09:00:333
2403599386,5cyclictest7850irq/56-dwc_otg_09:00:333
2403599372,13cyclictest0-21swapper/308:32:413
2403599361,6cyclictest0-21swapper/307:50:163
2403599359,6cyclictest7950irq/56-dwc_otg_08:00:053
24035993428,4cyclictest13353-21idleruntime-cro08:10:063
2403599331,24cyclictest6030-21latency_hist07:50:053
2403599301,15cyclictest19958-21cat08:25:313
2403599287,5cyclictest7750irq/56-dwc_otg08:43:283
2403599286,10cyclictest7950irq/56-dwc_otg_08:23:243
2403599281,8cyclictest23710-21grep08:35:323
2403599281,4cyclictest0-21swapper/309:00:063
237862287,11sleep30-21swapper/307:10:063
2403599272,10cyclictest7850irq/56-dwc_otg_07:40:243
2403599271,12cyclictest7950irq/56-dwc_otg_07:25:063
2403599268,8cyclictest7750irq/56-dwc_otg08:15:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional