You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 15:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Sun Apr 26, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3002799290,28cyclictest0-21swapper/109:47:591
3002799280,22cyclictest4146-21apt-get08:30:021
3002799270,0cyclictest0-21swapper/111:31:181
3002799270,0cyclictest0-21swapper/109:21:511
3002799260,0cyclictest0-21swapper/110:00:361
3002999250,24cyclictest24589-21diskmemload11:01:463
3002999250,24cyclictest24589-21diskmemload09:12:243
3002999250,24cyclictest2266-21rm09:19:583
3002899250,24cyclictest24589-21diskmemload12:16:392
3002899250,24cyclictest0-21swapper/211:19:392
30027992520,4cyclictest32922sleep109:51:191
30027992520,4cyclictest0-21swapper/112:05:371
30027992519,5cyclictest0-21swapper/110:20:401
3002799250,25cyclictest0-21swapper/112:37:541
3002799250,24cyclictest24589-21diskmemload12:26:161
3002799250,24cyclictest24589-21diskmemload10:11:271
3002799250,24cyclictest1534-21ssh09:18:431
3002799250,24cyclictest0-21swapper/109:29:581
3002799250,22cyclictest0-21swapper/110:55:131
3002799250,21cyclictest24589-21diskmemload11:39:091
3002799250,21cyclictest24589-21diskmemload10:45:201
3002799250,21cyclictest0-21swapper/112:16:081
3002699250,24cyclictest24589-21diskmemload11:58:030
3002999240,24cyclictest0-21swapper/310:36:433
3002999240,23cyclictest0-21swapper/312:21:113
3002999240,1cyclictest0-21swapper/312:17:183
3002999240,1cyclictest0-21swapper/309:52:003
30028992423,1cyclictest0-21swapper/209:46:292
30028992423,0cyclictest0-21swapper/210:22:042
30028992422,1cyclictest0-21swapper/209:28:052
30027992422,2cyclictest0-21swapper/111:57:511
30027992421,3cyclictest0-21swapper/110:26:441
30027992420,3cyclictest0-21swapper/111:28:211
30027992420,3cyclictest0-21swapper/107:20:371
30027992419,4cyclictest22154-21ssh09:39:021
30027992417,6cyclictest15573-21ssh11:06:531
3002799240,24cyclictest0-21swapper/110:51:191
3002799240,24cyclictest0-21swapper/110:17:491
3002799240,23cyclictest0-21swapper/111:42:011
3002799240,23cyclictest0-21swapper/110:07:301
3002799240,20cyclictest0-21swapper/110:41:591
3002799240,0cyclictest0-21swapper/111:17:471
3002799240,0cyclictest0-21swapper/110:37:411
30026992424,0cyclictest0-21swapper/009:40:040
30026992423,1cyclictest5672-21ssh09:22:110
3002699240,24cyclictest0-21swapper/012:19:440
3002699240,24cyclictest0-21swapper/010:31:160
3002699240,0cyclictest0-21swapper/012:21:560
30029992323,0cyclictest24589-21diskmemload11:40:203
30029992323,0cyclictest0-21swapper/312:25:133
30029992323,0cyclictest0-21swapper/311:09:553
30029992323,0cyclictest0-21swapper/310:24:523
30029992323,0cyclictest0-21swapper/309:58:223
30029992321,1cyclictest13272-21ssh10:00:543
30029992321,1cyclictest0-21swapper/312:31:233
30029992321,1cyclictest0-21swapper/312:12:173
30029992321,1cyclictest0-21swapper/311:31:153
30029992321,1cyclictest0-21swapper/311:14:143
3002999230,23cyclictest0-21swapper/310:41:473
3002999230,22cyclictest8866-21perf10:30:013
3002999230,22cyclictest24589-21diskmemload11:56:323
3002999230,22cyclictest11535-21sh12:06:343
3002999230,22cyclictest0-21swapper/310:05:413
3002999230,0cyclictest0-21swapper/311:27:043
30028992323,0cyclictest0-21swapper/210:18:422
30028992323,0cyclictest0-21swapper/209:35:152
30028992322,1cyclictest0-21swapper/209:30:242
30028992321,1cyclictest0-21swapper/212:14:462
30028992321,1cyclictest0-21swapper/210:06:302
30028992320,2cyclictest4093-21sh09:52:392
3002899231,21cyclictest24589-21diskmemload10:42:122
3002899231,0cyclictest0-21swapper/211:25:402
3002899230,23cyclictest0-21swapper/210:11:212
3002899230,22cyclictest9413-21apt-get10:30:372
3002899230,22cyclictest29708-21sh11:53:132
3002899230,22cyclictest10413-21ssh12:37:302
3002899230,22cyclictest0-21swapper/212:05:162
3002899230,1cyclictest30936-21kworker/u8:210:01:072
3002899230,1cyclictest24589-21diskmemload10:26:062
3002899230,1cyclictest0-21swapper/212:25:522
3002899230,0cyclictest24589-21diskmemload09:56:112
3002899230,0cyclictest0-21swapper/211:40:372
30027992323,0cyclictest0-21swapper/111:53:091
30027992322,1cyclictest0-21swapper/112:03:021
30027992321,1cyclictest23861-21df09:40:381
30027992321,1cyclictest0-21swapper/112:20:231
30027992321,1cyclictest0-21swapper/111:05:001
30027992320,3cyclictest0-21swapper/111:20:341
30027992317,5cyclictest7201-21perf07:30:001
3002799230,23cyclictest24589-21diskmemload11:46:011
3002799230,23cyclictest0-21swapper/112:13:081
3002799230,23cyclictest0-21swapper/110:32:391
3002799230,22cyclictest609-21rs:main1
3002799230,22cyclictest17777-21sh11:10:031
3002799230,22cyclictest16969-21wc07:50:001
3002799230,22cyclictest13117-21ssh09:30:331
30026992323,0cyclictest0-21swapper/011:40:370
30026992323,0cyclictest0-21swapper/011:05:030
30026992322,1cyclictest0-21swapper/009:33:200
30026992321,1cyclictest0-21swapper/012:06:340
30026992321,1cyclictest0-21swapper/009:51:590
30026992320,2cyclictest5047-21ssh10:57:030
30026992320,2cyclictest0-21swapper/012:12:210
3002699230,23cyclictest0-21swapper/010:02:020
3002699230,22cyclictest30999-21ssh11:22:100
3002699230,22cyclictest24589-21diskmemload11:16:310
3002699230,22cyclictest16891-21ssh10:36:340
3002699230,22cyclictest0-21swapper/010:51:510
3002699230,22cyclictest0-21swapper/010:45:400
3002699230,1cyclictest2634-21diskmemload12:30:390
3002699230,1cyclictest0-21swapper/009:58:050
3002699230,0cyclictest24589-21diskmemload11:27:300
3002699230,0cyclictest0-21swapper/010:14:030
30029992222,0cyclictest0-21swapper/309:22:583
30029992221,1cyclictest0-21swapper/309:35:463
30029992220,1cyclictest26364-21ssh11:50:373
30029992220,1cyclictest21519-21apt-get10:10:373
30029992220,1cyclictest0-21swapper/312:35:013
30029992220,1cyclictest0-21swapper/310:50:403
30029992220,1cyclictest0-21swapper/310:20:013
30029992219,2cyclictest11161-21grep10:30:463
3002999220,21cyclictest30765-21sh09:46:283
3002999220,21cyclictest30315-21apt-get07:10:373
3002999220,21cyclictest28145-21sh11:20:233
3002999220,21cyclictest14909-21apt-get08:50:363
3002999220,21cyclictest0-21swapper/311:36:593
3002999220,21cyclictest0-21swapper/310:55:373
3002999220,21cyclictest0-21swapper/309:31:023
3002999220,1cyclictest8485-21munin-run12:05:013
3002999220,1cyclictest0-21swapper/311:16:273
3002999220,0cyclictest0-21swapper/309:28:223
30028992222,0cyclictest0-21swapper/211:45:102
30028992222,0cyclictest0-21swapper/210:56:372
30028992222,0cyclictest0-21swapper/210:50:432
30028992222,0cyclictest0-21swapper/210:47:192
30028992222,0cyclictest0-21swapper/208:05:362
30028992221,1cyclictest5943-21ssh11:30:232
30028992221,1cyclictest28279-21kworker/u8:212:00:052
30028992221,1cyclictest0-21swapper/209:10:082
30028992221,0cyclictest0-21swapper/212:20:252
3002899220,22cyclictest0-21swapper/211:10:262
3002899220,22cyclictest0-21swapper/209:42:152
3002899220,21cyclictest7524-21apt-get11:00:362
3002899220,21cyclictest2068-21apt-get08:25:362
3002899220,21cyclictest16478-21ssh10:35:562
3002899220,21cyclictest0-21swapper/211:55:012
3002899220,21cyclictest0-21swapper/211:20:382
3002899220,21cyclictest0-21swapper/211:05:032
3002899220,21cyclictest0-21swapper/209:22:342
3002899220,21cyclictest0-21swapper/208:10:372
3002899220,21cyclictest0-21swapper/207:35:372
3002899220,1cyclictest4860-21apt-get08:30:352
3002899220,1cyclictest0-21swapper/209:16:012
3002899220,0cyclictest0-21swapper/211:35:172
30027992221,1cyclictest0-21swapper/109:13:231
30027992220,1cyclictest9533-21sh09:58:091
30027992219,2cyclictest2387-21tr07:20:011
3002799220,21cyclictest11830-21latency_hist08:45:011
3002799220,21cyclictest0-21swapper/108:50:361
3002799220,21cyclictest0-21swapper/108:35:371
3002799220,1cyclictest4146-21apt-get08:30:001
30026992222,0cyclictest24589-21diskmemload12:35:040
30026992222,0cyclictest24589-21diskmemload09:38:000
30026992222,0cyclictest24589-21diskmemload09:13:060
30026992222,0cyclictest0-21swapper/011:51:530
30026992222,0cyclictest0-21swapper/011:30:020
30026992222,0cyclictest0-21swapper/010:43:310
30026992221,1cyclictest7936-21sh09:25:290
30026992221,1cyclictest62550irq/127-eno110:20:370
30026992220,1cyclictest12186-21sendmail-msp07:40:000
3002699220,22cyclictest11368-21sh11:04:010
3002699220,21cyclictest5109-21apt-get07:25:350
3002699220,21cyclictest23272-21ssh11:46:060
3002699220,21cyclictest20231-21ssh11:11:060
3002699220,21cyclictest16212-21ssh10:05:130
3002699220,1cyclictest6823-21sh12:02:150
3002699220,0cyclictest4101-21ssh10:25:170
3002699220,0cyclictest0-21swapper/012:29:530
30029992121,0cyclictest0-21swapper/308:30:353
30029992120,0cyclictest0-21swapper/307:30:353
30029992119,1cyclictest19768-21munin-run07:55:013
30029992118,2cyclictest2416-21latency_hist07:20:013
3002999210,21cyclictest0-21swapper/311:45:153
3002999210,20cyclictest23436-21apt-get09:40:373
3002999210,20cyclictest0-21swapper/307:25:353
30028992119,1cyclictest12122-21apt-get08:45:382
3002899210,20cyclictest22221-21idleruntime-cro09:05:012
3002899210,0cyclictest0-21swapper/208:15:372
3002799210,20cyclictest20058-21apt-get07:55:361
3002799210,20cyclictest0-21swapper/109:05:361
3002799210,0cyclictest22478-21apt-get08:00:371
3002799210,0cyclictest0-21swapper/108:20:361
30026992120,1cyclictest32122-21ssh09:15:480
3002699210,21cyclictest24589-21diskmemload09:47:150
3002699210,21cyclictest0-21swapper/010:15:310
3002699210,0cyclictest20042-21apt-get09:00:020
30029992020,0cyclictest0-21swapper/307:35:373
30029992017,2cyclictest1773-21perf08:25:003
3002999200,0cyclictest0-21swapper/308:35:373
3002999200,0cyclictest0-21swapper/307:45:373
30028992020,0cyclictest0-21swapper/208:50:362
30028992019,1cyclictest9358-21perf08:40:002
30028992018,1cyclictest16961-21apt-get07:50:002
3002899200,0cyclictest17662-21apt-get07:50:362
3002899200,0cyclictest0-21swapper/209:05:362
3002899200,0cyclictest0-21swapper/207:20:372
30027992020,0cyclictest29657-21apt-get08:15:361
30027992020,0cyclictest0-21swapper/109:00:361
30027992018,1cyclictest32415-21latency_hist07:15:011
3002799200,0cyclictest0-21swapper/108:45:381
3002799200,0cyclictest0-21swapper/107:50:361
30026992020,0cyclictest0-21swapper/007:15:360
30026992019,1cyclictest0-21swapper/007:50:020
3002699200,20cyclictest0-21swapper/008:20:360
3002699200,0cyclictest0-21swapper/007:20:380
30029991919,0cyclictest22515-21apt-get09:05:363
30029991919,0cyclictest0-21swapper/308:15:363
30029991919,0cyclictest0-21swapper/308:05:353
30029991918,0cyclictest0-21swapper/308:40:373
30028991919,0cyclictest17305-21apt-get08:55:342
30028991919,0cyclictest0-21swapper/207:30:352
30028991917,1cyclictest0-21swapper/207:45:002
30027991919,0cyclictest0-21swapper/107:30:351
30026991919,0cyclictest0-21swapper/008:15:360
30026991919,0cyclictest0-21swapper/008:05:350
30026991919,0cyclictest0-21swapper/008:00:370
30026991919,0cyclictest0-21swapper/007:45:370
30026991919,0cyclictest0-21swapper/007:40:350
30029991818,0cyclictest0-21swapper/309:00:363
30026991818,0cyclictest0-21swapper/008:50:360
30026991818,0cyclictest0-21swapper/008:30:350
30026991818,0cyclictest0-21swapper/008:25:360
30026991818,0cyclictest0-21swapper/007:10:370
30028991717,0cyclictest0-21swapper/207:55:352
30028991716,0cyclictest0-21swapper/208:00:372
3002899170,16cyclictest7176-21cron07:30:002
30027991717,0cyclictest27263-21apt-get08:10:371
30026991716,1cyclictest0-21swapper/009:00:010
30026991716,0cyclictest12122-21apt-get08:45:380
30029991616,0cyclictest0-21swapper/308:45:383
30029991616,0cyclictest0-21swapper/308:00:373
30029991615,1cyclictest12477-21apt-get07:40:363
30029991614,1cyclictest29418-21grep08:15:013
30029991614,1cyclictest0-21swapper/307:55:453
30027991616,0cyclictest0-21swapper/108:05:351
30026991616,0cyclictest0-21swapper/008:40:370
3002999153,11cyclictest793-21lldpd08:28:253
30027991514,0cyclictest0-21swapper/108:55:341
3002699150,14cyclictest8304-21irqstats07:30:390
3002699150,14cyclictest0-21swapper/008:35:360
3002699150,14cyclictest0-21swapper/007:55:360
3002999140,14cyclictest0-21swapper/307:20:053
3002999140,0cyclictest0-21swapper/308:55:133
30028991414,0cyclictest0-21swapper/208:20:082
3002899140,7cyclictest0-21swapper/207:10:362
3002899140,0cyclictest0-21swapper/208:40:302
3002899140,0cyclictest0-21swapper/207:16:072
30026991414,0cyclictest0-21swapper/009:05:240
3002699140,0cyclictest0-21swapper/008:11:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional