You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 22:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Sep 07, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13207992523,1cyclictest28202-21ssh12:21:413
13206992523,1cyclictest6929-21diskmemload11:41:492
1320699250,24cyclictest20292-21kworker/u8:111:56:502
13204992523,1cyclictest12371-21rm09:14:111
13204992522,2cyclictest8086-21ssh12:02:111
1320499250,24cyclictest6929-21diskmemload09:29:011
1320499250,24cyclictest25591-21awk07:35:001
1320399253,1cyclictest62550irq/127-eno110:56:520
1320399250,24cyclictest6929-21diskmemload12:03:110
1320399250,24cyclictest0-21swapper/012:35:190
1320399250,24cyclictest0-21swapper/010:30:080
13207992423,1cyclictest0-21swapper/309:36:253
1320799240,2cyclictest23776-21sh09:24:113
1320799240,23cyclictest6929-21diskmemload12:35:503
1320799240,23cyclictest6929-21diskmemload09:11:203
1320799240,23cyclictest0-21swapper/311:01:253
1320799240,23cyclictest0-21swapper/310:11:223
1320799240,23cyclictest0-21swapper/310:11:223
1320799240,23cyclictest0-21swapper/309:47:433
1320799240,1cyclictest0-21swapper/309:33:513
1320799240,0cyclictest0-21swapper/312:16:063
13206992422,1cyclictest0-21swapper/211:10:372
13206992420,4cyclictest0-21swapper/212:31:162
13206992420,0cyclictest0-21swapper/212:28:472
13206992419,1cyclictest0-21swapper/210:11:492
13206992419,1cyclictest0-21swapper/210:11:492
1320699240,23cyclictest0-21swapper/212:10:362
1320699240,0cyclictest0-21swapper/209:29:462
13204992423,1cyclictest25356-21sh09:54:481
13204992423,0cyclictest12424-21ssh12:36:321
1320499240,2cyclictest30179-21sh09:58:501
1320499240,24cyclictest0-21swapper/110:45:361
1320499240,23cyclictest6929-21diskmemload10:02:581
1320499240,23cyclictest0-21swapper/112:28:511
1320499240,23cyclictest0-21swapper/111:47:111
1320499240,1cyclictest30214-21ssh12:22:051
1320499240,1cyclictest18588-21ssh09:48:151
1320499240,0cyclictest0-21swapper/111:24:311
1320499240,0cyclictest0-21swapper/110:58:111
13203992423,1cyclictest0-21swapper/011:14:580
13203992421,2cyclictest30459-21sh12:22:220
1320399240,23cyclictest6929-21diskmemload10:46:480
1320399240,23cyclictest6929-21diskmemload10:42:180
1320399240,23cyclictest6929-21diskmemload10:28:570
1320399240,23cyclictest0-21swapper/011:50:010
1320399240,0cyclictest0-21swapper/012:33:400
1320399240,0cyclictest0-21swapper/011:06:410
13207992323,0cyclictest6929-21diskmemload10:28:413
13207992323,0cyclictest0-21swapper/311:15:473
13207992323,0cyclictest0-21swapper/310:34:363
13207992323,0cyclictest0-21swapper/310:22:373
13207992322,1cyclictest6929-21diskmemload10:44:093
13207992322,1cyclictest0-21swapper/312:12:003
13207992321,1cyclictest10269-21latency_hist10:10:003
13207992320,2cyclictest948-21sh12:26:093
1320799230,23cyclictest0-21swapper/310:16:023
1320799230,22cyclictest6929-21diskmemload10:45:223
1320799230,22cyclictest13397-21ssh09:43:443
1320799230,0cyclictest6929-21diskmemload10:50:493
13206992323,0cyclictest31670-21ssh10:00:302
13206992323,0cyclictest0-21swapper/212:18:152
13206992323,0cyclictest0-21swapper/210:53:132
13206992323,0cyclictest0-21swapper/209:53:332
13206992323,0cyclictest0-21swapper/209:42:252
13206992322,1cyclictest24887-21ssh10:21:542
13206992321,1cyclictest4939-21apt-get09:06:412
13206992320,2cyclictest8104-21perf08:05:012
13206992320,2cyclictest718-21ssh10:30:152
13206992320,2cyclictest6739-21ssh10:35:532
1320699230,2cyclictest6284-21ssh11:04:042
1320699230,23cyclictest6929-21diskmemload11:47:252
1320699230,23cyclictest0-21swapper/212:36:292
1320699230,23cyclictest0-21swapper/211:51:142
1320699230,23cyclictest0-21swapper/210:06:122
1320699230,23cyclictest0-21swapper/209:16:022
1320699230,22cyclictest7485-21ssh09:10:222
1320699230,22cyclictest2905-21munin-run07:55:012
1320699230,22cyclictest27359-21sh08:45:012
1320699230,22cyclictest26919-21ssh09:56:362
1320699230,22cyclictest0-21swapper/211:35:362
1320699230,0cyclictest6929-21diskmemload10:47:542
13204992323,0cyclictest0-21swapper/112:11:271
13204992323,0cyclictest0-21swapper/110:40:551
13204992323,0cyclictest0-21swapper/110:36:391
13204992323,0cyclictest0-21swapper/110:28:561
13204992323,0cyclictest0-21swapper/109:17:271
13204992322,1cyclictest30225-21ssh09:30:021
13204992321,2cyclictest26539-21ssh11:51:141
13204992321,1cyclictest21365-21ssh09:21:471
13204992321,1cyclictest0-21swapper/111:55:081
13204992321,1cyclictest0-21swapper/110:33:001
13204992320,2cyclictest13205-21sh11:10:381
1320499230,22cyclictest32544-21apt-get08:56:431
1320499230,22cyclictest18870-21ssh11:15:421
1320499230,22cyclictest15024-21ssh11:40:591
1320499230,22cyclictest10840-21sh12:34:421
1320499230,0cyclictest0-21swapper/111:30:091
1320499230,0cyclictest0-21swapper/111:25:241
13203992323,0cyclictest0-21swapper/011:27:520
13203992323,0cyclictest0-21swapper/009:46:170
13203992323,0cyclictest0-21swapper/009:25:490
13203992323,0cyclictest0-21swapper/009:20:580
13203992321,2cyclictest0-21swapper/010:00:260
13203992321,1cyclictest0-21swapper/012:06:460
13203992321,1cyclictest0-21swapper/011:30:100
13203992321,1cyclictest0-21swapper/009:31:080
13203992321,1cyclictest0-21swapper/009:10:180
1320399231,1cyclictest62550irq/127-eno110:35:520
1320399230,23cyclictest0-21swapper/011:42:280
1320399230,23cyclictest0-21swapper/009:19:140
1320399230,22cyclictest6929-21diskmemload10:11:290
1320399230,22cyclictest6929-21diskmemload10:11:290
1320399230,22cyclictest25801-21sh12:18:420
1320399230,22cyclictest22051-21sh10:20:220
1320399230,22cyclictest20490-21apt-get08:31:420
1320399230,22cyclictest0-21swapper/011:20:140
1320399230,22cyclictest0-21swapper/011:01:050
1320399230,22cyclictest0-21swapper/010:07:230
1320399230,1cyclictest19458-21sh11:16:330
1320399230,0cyclictest6929-21diskmemload11:52:230
1320399230,0cyclictest0-21swapper/009:41:520
13207992222,0cyclictest0-21swapper/312:31:253
13207992221,1cyclictest0-21swapper/309:55:543
13207992220,1cyclictest6929-21diskmemload09:51:413
13207992220,1cyclictest3273-21apt-get07:56:423
13207992220,1cyclictest30895-21apt-get07:46:413
13207992220,1cyclictest0-21swapper/311:51:363
13207992220,1cyclictest0-21swapper/311:32:123
1320799220,22cyclictest0-21swapper/312:00:083
1320799220,22cyclictest0-21swapper/309:28:063
1320799220,21cyclictest6929-21diskmemload11:55:293
1320799220,21cyclictest18093-21apt-get08:26:413
1320799220,21cyclictest0-21swapper/311:46:363
1320799220,21cyclictest0-21swapper/311:10:303
1320799220,21cyclictest0-21swapper/311:05:123
1320799220,21cyclictest0-21swapper/308:41:413
1320799220,21cyclictest0-21swapper/308:21:413
1320799220,21cyclictest0-21swapper/307:36:413
1320799220,1cyclictest6929-21diskmemload11:21:073
1320799220,1cyclictest629-21diskmemload10:01:413
1320799220,1cyclictest0-21swapper/311:38:433
1320799220,1cyclictest0-21swapper/311:25:143
1320799220,1cyclictest0-21swapper/310:56:513
1320799220,1cyclictest0-21swapper/310:35:013
13206992222,0cyclictest6929-21diskmemload12:05:062
13206992222,0cyclictest0-21swapper/211:17:212
13206992222,0cyclictest0-21swapper/209:33:352
13206992221,1cyclictest6929-21diskmemload11:22:302
13206992221,1cyclictest12938-21ssh10:41:382
13206992220,2cyclictest0-21swapper/210:55:092
13206992220,1cyclictest29078-21grep07:41:432
13206992220,1cyclictest27695-21sh10:25:272
13206992220,1cyclictest0-21swapper/212:21:102
13206992220,1cyclictest0-21swapper/209:00:002
1320699220,2cyclictest14659-21ssh09:45:122
1320699220,22cyclictest6929-21diskmemload11:30:012
1320699220,21cyclictest5803-21ntp_states09:36:472
1320699220,21cyclictest30598-21ssh11:26:232
1320699220,21cyclictest22943-21apt-get08:36:412
1320699220,21cyclictest0-21swapper/210:15:202
1320699220,21cyclictest0-21swapper/209:21:472
1320699220,1cyclictest7186-21ssh12:01:492
13204992222,0cyclictest0-21swapper/110:18:091
13204992220,1cyclictest4495-21sh09:36:291
13204992219,2cyclictest605-21avahi-daemon08:45:011
13204992219,2cyclictest22820-21idleruntime-cro07:30:001
1320499220,22cyclictest0-21swapper/111:35:481
1320499220,21cyclictest2169-21ssh11:00:471
1320499220,21cyclictest0-21swapper/110:50:211
1320499220,21cyclictest0-21swapper/107:50:001
1320499220,1cyclictest9254-21sh09:40:261
1320499220,1cyclictest25981-21apt-get07:36:411
1320499220,1cyclictest22454-21ssh12:16:231
1320499220,1cyclictest10897-21ssh12:05:531
13203992222,0cyclictest0-21swapper/009:36:310
13203992221,1cyclictest6929-21diskmemload12:12:500
13203992220,1cyclictest62550irq/127-eno110:15:010
1320399220,21cyclictest25360-21apt-get08:41:410
1320399220,21cyclictest2496-21ssh12:26:470
1320399220,21cyclictest2170-21idleruntime-cro09:00:000
1320399220,21cyclictest0-21swapper/011:55:390
1320399220,21cyclictest0-21swapper/011:36:160
1320399220,21cyclictest0-21swapper/009:57:090
1320399220,21cyclictest0-21swapper/008:51:410
1320399220,1cyclictest0-21swapper/010:50:110
1320399220,0cyclictest0-21swapper/009:51:230
13207992119,1cyclictest865-21apt-get07:51:413
1320799210,21cyclictest0-21swapper/312:05:033
1320799210,21cyclictest0-21swapper/308:51:413
1320699210,20cyclictest7562-21ssh11:05:282
1320699210,20cyclictest10873-21apt-get08:11:412
1320699210,20cyclictest0-21swapper/208:31:422
1320699210,1cyclictest10488-21perf08:10:002
13204992121,0cyclictest0-21swapper/110:20:211
13204992121,0cyclictest0-21swapper/108:21:411
13204992120,1cyclictest8476-21apt-get08:06:391
13204992120,1cyclictest32158-21perf08:55:001
13204992120,1cyclictest24982-21sendmail-msp08:40:011
1320499210,21cyclictest0-21swapper/111:05:101
1320499210,21cyclictest0-21swapper/110:10:411
1320499210,21cyclictest0-21swapper/110:10:411
1320499210,20cyclictest0-21swapper/107:51:411
13203992120,1cyclictest13276-21apt-get08:16:410
13203992120,1cyclictest0-21swapper/007:31:410
13203992120,0cyclictest0-21swapper/007:16:420
1320399211,20cyclictest9844-21kworker/0:208:26:320
1320399210,20cyclictest0-21swapper/008:00:020
1320399210,20cyclictest0-21swapper/007:56:420
1320399210,0cyclictest0-21swapper/007:51:410
13207992020,0cyclictest0-21swapper/308:31:423
13206992020,0cyclictest30145-21apt-get08:51:412
13206992020,0cyclictest23586-21apt-get07:31:412
13206992019,0cyclictest2545-21apt-get09:01:402
13206992018,1cyclictest15926-21apt-get07:16:422
1320699200,0cyclictest0-21swapper/207:56:422
13204992020,0cyclictest0-21swapper/107:41:401
13204992019,0cyclictest0-21swapper/108:31:421
13204992017,2cyclictest15540-21latency_hist07:15:011
13207991919,0cyclictest0-21swapper/308:06:393
13207991919,0cyclictest0-21swapper/308:01:413
13207991919,0cyclictest0-21swapper/307:31:413
13206991919,0cyclictest0-21swapper/208:16:412
13206991919,0cyclictest0-21swapper/207:21:412
13204991919,0cyclictest0-21swapper/109:01:401
13203991919,0cyclictest0-21swapper/009:01:400
13203991919,0cyclictest0-21swapper/008:46:420
13203991919,0cyclictest0-21swapper/008:11:410
13203991919,0cyclictest0-21swapper/007:11:410
13203991918,1cyclictest0-21swapper/008:36:410
13203991917,1cyclictest28126-21perf07:40:000
1320399190,19cyclictest9844-21kworker/0:209:05:240
13207991818,0cyclictest0-21swapper/308:56:433
13206991818,0cyclictest0-21swapper/208:26:412
13206991818,0cyclictest0-21swapper/207:26:422
13204991818,0cyclictest0-21swapper/108:11:411
13204991817,0cyclictest0-21swapper/108:16:411
13204991816,1cyclictest8106-21munin-plugin-st08:05:011
13203991818,0cyclictest0-21swapper/008:06:390
13203991818,0cyclictest0-21swapper/007:41:400
13207991717,0cyclictest0-21swapper/307:11:413
13206991717,0cyclictest15698-21apt-get08:21:412
13204991717,0cyclictest0-21swapper/109:06:411
13204991717,0cyclictest0-21swapper/107:56:421
13203991717,0cyclictest0-21swapper/007:26:430
13207991615,1cyclictest0-21swapper/309:01:413
13204991614,1cyclictest605-21avahi-daemon07:20:001
13203991616,0cyclictest0-21swapper/007:50:000
13203991616,0cyclictest0-21swapper/007:21:410
13207991513,1cyclictest0-21swapper/308:11:433
1320799150,1cyclictest20013-21unixbench_multi07:21:513
1320699150,14cyclictest0-21swapper/208:46:472
13204991515,0cyclictest0-21swapper/108:26:411
1320799140,14cyclictest0-21swapper/309:06:173
1320799140,14cyclictest0-21swapper/308:45:553
1320799140,14cyclictest0-21swapper/308:15:143
1320799140,14cyclictest0-21swapper/307:40:083
1320799140,14cyclictest0-21swapper/307:16:023
1320799140,0cyclictest0-21swapper/308:35:323
1320799140,0cyclictest0-21swapper/307:26:343
13206991414,0cyclictest0-21swapper/207:11:202
1320699140,5cyclictest0-21swapper/207:36:412
1320699140,14cyclictest0-21swapper/207:46:072
1320499140,0cyclictest0-21swapper/108:46:261
1320399140,14cyclictest0-21swapper/008:20:580
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional