You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 20:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 24, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1548099282,25cyclictest606-21dbus-daemon08:05:010
15486992521,1cyclictest31056-21ssh11:21:432
15486992520,4cyclictest0-21swapper/211:55:452
15486992520,4cyclictest0-21swapper/211:55:452
15486992520,2cyclictest0-21swapper/212:30:112
15484992523,1cyclictest9589-21diskmemload11:35:071
15484992523,1cyclictest9589-21diskmemload10:45:431
15484992523,1cyclictest0-21swapper/109:12:261
1548499250,24cyclictest9589-21diskmemload09:53:361
1548499250,24cyclictest13435-21ssh12:04:061
15490992423,0cyclictest0-21swapper/310:49:023
15490992422,1cyclictest0-21swapper/311:09:363
15490992422,1cyclictest0-21swapper/309:52:563
1549099240,23cyclictest0-21swapper/312:18:073
1549099240,23cyclictest0-21swapper/310:02:483
1549099240,23cyclictest0-21swapper/307:55:293
1549099240,1cyclictest576-21ssh09:30:173
15486992423,1cyclictest0-21swapper/210:30:082
15484992423,0cyclictest32217-21apt-get10:55:301
15484992422,1cyclictest0-21swapper/111:20:341
15484992421,2cyclictest29927-21rm09:26:251
1548499241,22cyclictest0-21swapper/109:55:331
1548499240,24cyclictest0-21swapper/110:22:321
1548499240,23cyclictest9589-21diskmemload11:51:481
1548499240,23cyclictest9589-21diskmemload11:00:141
1548499240,23cyclictest4570-21ssh09:33:201
1548499240,23cyclictest12438-21idleruntime-cro11:35:001
1548499240,0cyclictest0-21swapper/109:42:381
15480992423,0cyclictest0-21swapper/009:45:330
15480992422,1cyclictest0-21swapper/009:35:170
1548099240,24cyclictest0-21swapper/011:21:270
1548099240,23cyclictest9589-21diskmemload12:16:380
1548099240,23cyclictest0-21swapper/012:23:310
1548099240,23cyclictest0-21swapper/011:35:020
1548099240,23cyclictest0-21swapper/011:07:060
1548099240,23cyclictest0-21swapper/010:53:280
1548099240,23cyclictest0-21swapper/010:32:430
1548099240,23cyclictest0-21swapper/009:24:240
1548099240,1cyclictest13616-21taskset12:04:190
1548099240,0cyclictest9589-21diskmemload10:20:380
15490992323,0cyclictest0-21swapper/312:33:393
15490992323,0cyclictest0-21swapper/310:43:263
15490992322,1cyclictest13148-21apt-get11:35:323
15490992321,1cyclictest9710-21ssh10:05:433
15490992321,1cyclictest20271-21perf07:20:013
15490992321,1cyclictest0-21swapper/311:42:503
15490992320,2cyclictest4343-21sh11:26:443
15490992320,2cyclictest22041-21awk12:40:003
15490992320,2cyclictest18193-21ssh10:14:233
15490992320,2cyclictest10755-21ssh09:39:063
1549099230,23cyclictest9589-21diskmemload09:48:013
1549099230,22cyclictest9589-21diskmemload10:50:333
1549099230,22cyclictest9589-21diskmemload09:14:363
1549099230,22cyclictest3198-21ssh11:55:163
1549099230,22cyclictest3198-21ssh11:55:163
1549099230,22cyclictest27242-21sendmail-msp08:40:003
1549099230,22cyclictest24544-21rm11:45:333
1549099230,22cyclictest20124-21ssh12:10:033
1549099230,22cyclictest1142-21ssh10:27:053
1549099230,1cyclictest14539-21ssh12:05:053
1549099230,0cyclictest0-21swapper/310:20:193
1549099230,0cyclictest0-21swapper/309:56:413
1549099230,0cyclictest0-21swapper/309:17:143
15486992323,0cyclictest9589-21diskmemload11:55:012
15486992323,0cyclictest0-21swapper/212:18:082
15486992323,0cyclictest0-21swapper/211:41:252
15486992323,0cyclictest0-21swapper/211:36:082
15486992323,0cyclictest0-21swapper/211:15:082
15486992323,0cyclictest0-21swapper/210:52:172
15486992321,1cyclictest0-21swapper/210:10:002
15486992320,2cyclictest18670-21ssh09:16:212
15486992319,0cyclictest0-21swapper/210:44:552
15486992318,4cyclictest20707-21ssh09:47:122
1548699231,21cyclictest0-21swapper/211:25:322
1548699230,23cyclictest9589-21diskmemload10:19:532
1548699230,23cyclictest0-21swapper/211:48:522
1548699230,23cyclictest0-21swapper/211:05:072
1548699230,23cyclictest0-21swapper/210:25:142
1548699230,23cyclictest0-21swapper/210:10:162
1548699230,23cyclictest0-21swapper/209:26:342
1548699230,23cyclictest0-21swapper/209:10:402
1548699230,22cyclictest0-21swapper/212:12:222
1548699230,0cyclictest9589-21diskmemload12:36:232
1548699230,0cyclictest9589-21diskmemload10:48:162
1548699230,0cyclictest0-21swapper/209:53:362
15484992323,0cyclictest0-21swapper/112:18:531
15484992323,0cyclictest0-21swapper/110:37:411
15484992322,1cyclictest0-21swapper/111:11:481
15484992322,1cyclictest0-21swapper/109:22:321
15484992322,1cyclictest0-21swapper/109:15:381
15484992321,1cyclictest0-21swapper/112:39:351
15484992321,1cyclictest0-21swapper/111:27:361
15484992320,2cyclictest9783-21ssh10:05:491
15484992320,2cyclictest24552-21sh11:45:331
1548499231,21cyclictest4769-21cron09:00:011
1548499230,2cyclictest5679-21ssh11:56:181
1548499230,2cyclictest5679-21ssh11:56:181
1548499230,22cyclictest0-21swapper/111:05:051
1548499230,22cyclictest0-21swapper/110:29:171
1548499230,22cyclictest0-21swapper/107:30:321
1548499230,1cyclictest0-21swapper/109:45:341
1548499230,0cyclictest0-21swapper/110:41:381
1548499230,0cyclictest0-21swapper/110:04:221
15480992323,0cyclictest9589-21diskmemload09:11:230
15480992323,0cyclictest62550irq/127-eno110:16:480
15480992323,0cyclictest0-21swapper/012:30:110
15480992323,0cyclictest0-21swapper/010:55:310
15480992323,0cyclictest0-21swapper/009:40:520
15480992322,1cyclictest9589-21diskmemload12:06:450
15480992322,1cyclictest0-21swapper/011:00:590
15480992322,1cyclictest0-21swapper/010:45:330
15480992321,1cyclictest17018-21apt-get12:35:330
1548099230,23cyclictest0-21swapper/011:50:440
1548099230,23cyclictest0-21swapper/011:40:540
1548099230,23cyclictest0-21swapper/009:17:220
1548099230,22cyclictest4769-21cron09:00:010
1548099230,22cyclictest2003-21latency_hist08:55:010
1548099230,22cyclictest15252-21timerandwakeup10:10:410
1548099230,22cyclictest0-21swapper/011:56:480
1548099230,22cyclictest0-21swapper/011:56:480
1548099230,22cyclictest0-21swapper/010:25:050
1548099230,0cyclictest0-21swapper/011:31:020
1548099230,0cyclictest0-21swapper/009:50:330
1548099230,0cyclictest0-21swapper/009:30:400
15490992222,0cyclictest0-21swapper/311:32:053
15490992222,0cyclictest0-21swapper/311:01:433
15490992222,0cyclictest0-21swapper/310:30:473
15490992222,0cyclictest0-21swapper/310:18:373
15490992221,1cyclictest13404-21ssh10:38:393
15490992221,1cyclictest0-21swapper/309:25:113
15490992220,1cyclictest32122-21sh12:20:203
15490992220,1cyclictest27530-21apt-get08:40:323
15490992220,1cyclictest14355-21perf08:15:013
15490992220,1cyclictest0-21swapper/307:45:003
1549099220,21cyclictest9251-21tr12:00:343
1549099220,21cyclictest30595-21df11:50:323
1549099220,21cyclictest28181-21ssh11:20:113
1549099220,21cyclictest20573-21apt-get07:20:293
1549099220,21cyclictest17296-21ssh11:10:343
1549099220,21cyclictest0-21swapper/311:18:113
1549099220,21cyclictest0-21swapper/310:55:043
1549099220,21cyclictest0-21swapper/308:55:023
1549099220,21cyclictest0-21swapper/308:00:323
1549099220,1cyclictest21572-21sh09:20:063
15486992222,0cyclictest0-21swapper/212:27:412
15486992222,0cyclictest0-21swapper/212:00:042
15486992222,0cyclictest0-21swapper/210:58:052
15486992222,0cyclictest0-21swapper/210:22:072
15486992222,0cyclictest0-21swapper/209:20:102
15486992221,1cyclictest3870-21ssh09:32:272
15486992221,1cyclictest10510-21ssh11:04:272
1548699220,21cyclictest32318-21apt-get08:50:332
1548699220,21cyclictest30987-21ssh09:55:562
1548699220,21cyclictest22687-21munin-run07:25:012
1548699220,21cyclictest1866-21ssh12:21:012
1548699220,21cyclictest16811-21ssh12:05:522
1548699220,1cyclictest9237-21ssh10:35:092
1548699220,0cyclictest9589-21diskmemload11:30:032
1548699220,0cyclictest6491-21apt-get09:35:322
15484992221,1cyclictest0-21swapper/112:20:461
15484992220,1cyclictest26393-21sh10:50:231
15484992220,1cyclictest10825-21sh12:30:041
15484992220,1cyclictest0-21swapper/110:30:331
15484992220,1cyclictest0-21swapper/110:12:091
1548499221,0cyclictest0-21swapper/111:16:351
1548499220,21cyclictest22718-21apt-get08:30:331
1548499220,21cyclictest0-21swapper/110:15:571
1548499220,21cyclictest0-21swapper/107:35:301
1548499220,1cyclictest0-21swapper/112:10:131
1548499220,1cyclictest0-21swapper/109:36:321
1548499220,0cyclictest9589-21diskmemload12:25:051
1548499220,0cyclictest0-21swapper/108:50:321
15480992222,0cyclictest0-21swapper/007:35:300
15480992221,1cyclictest27404-21diskmemload09:25:190
15480992220,1cyclictest14352-21basename08:15:010
15480992220,1cyclictest0-21swapper/011:25:170
1548099220,22cyclictest0-21swapper/010:07:380
1548099220,21cyclictest0-21swapper/012:25:250
1548099220,21cyclictest0-21swapper/010:40:230
1548099220,21cyclictest0-21swapper/010:35:390
1548099220,21cyclictest0-21swapper/008:20:320
1548099220,1cyclictest22772-21apt-get11:15:320
1548099220,0cyclictest9589-21diskmemload10:00:490
1548099220,0cyclictest0-21swapper/011:45:580
1548099220,0cyclictest0-21swapper/011:10:160
1548099220,0cyclictest0-21swapper/009:58:270
15490992120,1cyclictest5130-21ssh12:25:013
15490992118,2cyclictest2002-21sh08:55:013
1549099210,20cyclictest27759-21apt-get07:35:303
1549099210,20cyclictest0-21swapper/308:30:323
1549099210,20cyclictest0-21swapper/307:25:323
15486992121,0cyclictest9589-21diskmemload09:40:112
15486992119,2cyclictest0-21swapper/210:00:472
15486992118,2cyclictest313-21systemd-journal07:30:012
1548699210,21cyclictest0-21swapper/211:11:092
1548699210,0cyclictest18158-21apt-get07:15:322
15484992121,0cyclictest0-21swapper/107:15:321
1548499210,0cyclictest0-21swapper/112:06:031
15480992121,0cyclictest0-21swapper/007:15:320
15480992120,1cyclictest0-21swapper/008:15:330
15486992020,0cyclictest29923-21apt-get08:45:312
15486992020,0cyclictest29923-21apt-get08:45:312
15486992020,0cyclictest17535-21apt-get08:20:322
15486992020,0cyclictest0-21swapper/208:55:342
15486992020,0cyclictest0-21swapper/208:25:022
15486992020,0cyclictest0-21swapper/207:45:302
15486992020,0cyclictest0-21swapper/207:35:302
1548699200,20cyclictest0-21swapper/209:00:322
15484992020,0cyclictest0-21swapper/109:05:321
15484992020,0cyclictest0-21swapper/108:05:331
15484992018,1cyclictest0-21swapper/107:55:001
15480992020,0cyclictest0-21swapper/009:00:320
15480992020,0cyclictest0-21swapper/008:25:310
15480992020,0cyclictest0-21swapper/007:30:320
15480992019,0cyclictest0-21swapper/007:45:300
15490991919,0cyclictest32670-21apt-get07:45:293
15490991919,0cyclictest0-21swapper/308:15:333
15490991919,0cyclictest0-21swapper/307:50:323
15490991918,0cyclictest5116-21apt-get09:00:323
15486991919,0cyclictest15761-21apt-get07:10:302
15486991919,0cyclictest15761-21apt-get07:10:302
15486991919,0cyclictest14367-21apt-get08:15:022
15486991919,0cyclictest0-21swapper/207:55:302
15484991919,0cyclictest0-21swapper/109:00:321
15484991918,0cyclictest0-21swapper/108:20:321
15484991916,2cyclictest21737-21awk07:20:361
1548499190,18cyclictest0-21swapper/108:25:011
15480991919,0cyclictest0-21swapper/007:50:320
15480991919,0cyclictest0-21swapper/007:10:300
15480991919,0cyclictest0-21swapper/007:10:300
15480991918,1cyclictest0-21swapper/008:40:320
15490991818,0cyclictest25366-21apt-get07:30:323
15490991818,0cyclictest0-21swapper/309:05:323
15490991818,0cyclictest0-21swapper/308:45:313
15490991818,0cyclictest0-21swapper/308:45:313
15486991818,0cyclictest7472-21apt-get08:00:322
15486991818,0cyclictest30281-21apt-get07:40:322
15486991818,0cyclictest0-21swapper/208:40:322
15486991818,0cyclictest0-21swapper/207:50:322
1548499189,5cyclictest28045-21fschecks_time08:40:341
15484991818,0cyclictest0-21swapper/108:45:311
15484991818,0cyclictest0-21swapper/108:45:311
15484991818,0cyclictest0-21swapper/108:15:331
15484991815,2cyclictest0-21swapper/108:10:321
15480991818,0cyclictest0-21swapper/008:45:310
15480991818,0cyclictest0-21swapper/008:45:310
15480991818,0cyclictest0-21swapper/008:35:320
15490991716,1cyclictest20249-21apt-get08:25:023
15486991716,1cyclictest1649-21cron08:15:012
1548499172,1cyclictest0-21swapper/107:10:341
1548499172,1cyclictest0-21swapper/107:10:341
15484991715,2cyclictest0-21swapper/107:55:311
15480991717,0cyclictest0-21swapper/007:40:320
15486991616,0cyclictest0-21swapper/207:30:322
1548699160,15cyclictest9870-21apt-get08:05:332
1548499162,0cyclictest2373-21perf07:50:001
15484991616,0cyclictest0-21swapper/107:40:321
15484991616,0cyclictest0-21swapper/107:25:321
15480991616,0cyclictest0-21swapper/007:20:290
1549099150,14cyclictest0-21swapper/307:10:303
1549099150,14cyclictest0-21swapper/307:10:303
1548699150,14cyclictest26126-21/usr/sbin/munin08:35:372
15480991514,1cyclictest0-21swapper/007:25:420
15480991513,1cyclictest9619-21wc09:10:000
1548099150,15cyclictest0-21swapper/007:57:120
1549099140,14cyclictest0-21swapper/308:20:043
1549099140,14cyclictest0-21swapper/308:05:183
1548699140,14cyclictest0-21swapper/209:06:252
1548699140,14cyclictest0-21swapper/208:30:272
15484991414,0cyclictest0-21swapper/108:00:031
15480991414,0cyclictest0-21swapper/008:05:070
1548099140,0cyclictest0-21swapper/008:30:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional