You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 19:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3s.osadl.org (updated Mon Aug 31, 2026 12:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82622799126122,2cyclictest0-21swapper/009:20:020
82622799126122,2cyclictest0-21swapper/009:20:020
826232997726,15cyclictest275-21dbus-daemon07:39:591
826227997052,12cyclictest12-21ksoftirqd/010:00:020
826241996520,10cyclictest37-21ksoftirqd/309:10:023
82622799642,32cyclictest131rcu_preempt10:15:280
82622799642,32cyclictest131rcu_preempt10:15:280
826227996313,41cyclictest12-21ksoftirqd/010:51:020
826237996213,14cyclictest919761-21sh12:14:152
826227996229,4cyclictest12-21ksoftirqd/009:38:380
826232996145,13cyclictest865706-21kworker/1:111:40:021
826227996156,3cyclictest0-21swapper/007:25:020
82624199604,41cyclictest924910-21ssh12:25:023
826241996043,11cyclictest1-21systemd10:55:013
82623799609,16cyclictest887864-21ssh11:06:342
826237996017,7cyclictest30-21ksoftirqd/212:37:272
826237996012,10cyclictest30-21ksoftirqd/209:47:002
826237996010,14cyclictest905764-21sh11:44:422
826241995914,9cyclictest37-21ksoftirqd/312:06:053
826241995911,9cyclictest37-21ksoftirqd/311:02:123
82623799597,14cyclictest899190-21ssh11:30:272
826237995914,10cyclictest30-21ksoftirqd/212:24:352
826237995912,14cyclictest890920-21sh11:13:072
826237995910,14cyclictest884524-21sh10:59:552
826227995933,9cyclictest893561-21ssh11:18:450
826227995927,16cyclictest876278-21ssh10:42:050
82624199586,17cyclictest849586-21ssh09:45:303
82623799588,10cyclictest0-21swapper/210:00:502
826237995815,10cyclictest30-21ksoftirqd/209:17:032
826237995815,10cyclictest30-21ksoftirqd/209:17:032
826237995812,7cyclictest30-21ksoftirqd/207:55:012
826227995821,33cyclictest12-21ksoftirqd/009:25:000
82623799574,17cyclictest781585-1kworker/2:2H08:45:022
826237995715,9cyclictest30-21ksoftirqd/211:16:182
826237995712,9cyclictest30-21ksoftirqd/212:01:152
826227995727,15cyclictest867320-21ssh10:23:230
826227995725,17cyclictest858118-21ssh10:03:560
826227995725,13cyclictest872739-21ssh10:35:000
82622799571,53cyclictest0-21swapper/008:00:030
82622799571,41cyclictest844251-21ssh09:34:410
82624199568,9cyclictest37-21ksoftirqd/309:29:113
82624199568,9cyclictest37-21ksoftirqd/309:20:393
826241995614,11cyclictest37-21ksoftirqd/311:33:163
826237995614,9cyclictest30-21ksoftirqd/210:15:312
826237995614,9cyclictest30-21ksoftirqd/210:15:302
826237995614,9cyclictest30-21ksoftirqd/209:26:432
826237995613,10cyclictest30-21ksoftirqd/210:40:072
826237995612,9cyclictest30-21ksoftirqd/210:23:562
826237995612,10cyclictest30-21ksoftirqd/209:54:562
826227995651,3cyclictest831093-1kworker/0:0H08:50:020
826227995629,12cyclictest895483-21ssh11:22:470
82624199557,12cyclictest919914-21ssh12:14:343
82624199556,6cyclictest37-21ksoftirqd/309:41:583
826241995519,9cyclictest37-21ksoftirqd/312:00:033
826241995515,7cyclictest37-21ksoftirqd/309:11:053
826241995514,9cyclictest37-21ksoftirqd/309:35:013
826241995513,7cyclictest37-21ksoftirqd/310:20:023
826241995513,7cyclictest37-21ksoftirqd/310:20:023
826241995512,9cyclictest37-21ksoftirqd/309:20:013
826241995512,9cyclictest37-21ksoftirqd/309:20:003
82623799556,15cyclictest921014-21ssh12:16:332
826237995514,8cyclictest30-21ksoftirqd/212:28:022
82622799554,3cyclictest131rcu_preempt10:09:180
82622799552,17cyclictest870378-21unin-run10:30:010
82622799552,17cyclictest870378-21unin-run10:30:010
82624199546,10cyclictest37-21ksoftirqd/309:35:203
826241995414,9cyclictest0-21swapper/311:16:043
82623799544,12cyclictest833839-21ssh09:12:372
826237995411,7cyclictest30-21ksoftirqd/211:24:292
826237995410,6cyclictest30-21ksoftirqd/210:12:522
826227995428,12cyclictest850758-21ssh09:48:200
826227995428,11cyclictest917355-21ssh12:09:100
826227995427,11cyclictest852655-21ssh09:52:170
826227995426,24cyclictest921711-21ssh12:18:160
826227995426,13cyclictest890192-21ssh11:11:250
826227995421,29cyclictest12-21ksoftirqd/012:36:130
82624199537,12cyclictest832403-21diskmemload12:17:313
826241995314,10cyclictest0-21swapper/312:34:503
826241995311,9cyclictest37-21ksoftirqd/308:25:023
826241995311,9cyclictest37-21ksoftirqd/308:25:023
826241995311,9cyclictest0-21swapper/310:25:293
826241995311,9cyclictest0-21swapper/310:25:293
82623799539,11cyclictest0-21swapper/210:54:432
826237995313,7cyclictest30-21ksoftirqd/211:01:022
826237995310,11cyclictest0-21swapper/209:37:352
826227995335,13cyclictest3467602-21systemd-journal07:20:010
826227995335,13cyclictest3467602-21systemd-journal07:20:000
826227995334,4cyclictest16850irq/134-800000011:05:020
82622799533,43cyclictest842066-21grep09:30:020
826227995325,13cyclictest874955-21ssh10:39:420
826241995211,8cyclictest37-21ksoftirqd/307:59:153
82623799529,39cyclictest903699-21latency_hist11:40:022
82623299526,28cyclictest915593-21sh12:05:031
82622799523,44cyclictest0-21swapper/008:20:000
82622799523,10cyclictest275-21dbus-daemon07:50:010
826227995220,28cyclictest12-21ksoftirqd/011:06:470
82624199518,7cyclictest37-21ksoftirqd/311:50:013
82624199517,8cyclictest873368-21ssh10:35:533
826241995117,10cyclictest37-21ksoftirqd/311:37:323
826241995114,8cyclictest37-21ksoftirqd/310:10:023
826241995111,7cyclictest361rcuc/310:23:393
826227995125,11cyclictest927035-21ssh12:29:360
82622799512,3cyclictest131rcu_preempt12:11:400
826227995123,12cyclictest905474-21ssh11:43:560
826227995122,13cyclictest902157-21ssh11:36:420
826241995010,6cyclictest0-21swapper/311:07:263
82623799509,7cyclictest30-21ksoftirqd/211:50:152
82623799509,13cyclictest0-21swapper/210:34:202
82623799506,14cyclictest829380-21latency_hist08:10:022
826237995042,5cyclictest917786-21kworker/2:312:35:012
826237995040,6cyclictest863301-21kworker/2:010:37:052
826237995011,10cyclictest0-21swapper/209:57:522
826232995040,7cyclictest23-21ksoftirqd/112:00:181
826227995042,5cyclictest16950irq/224-800000009:00:010
826227995042,5cyclictest16950irq/224-800000009:00:010
826227995024,18cyclictest16850irq/134-800000012:25:010
826227995024,11cyclictest834148-21ssh09:13:250
826227995022,13cyclictest878906-21ssh10:47:450
826227995021,13cyclictest897025-21ssh11:25:560
82624199499,8cyclictest884835-21latency_hist11:00:033
82624199495,6cyclictest37-21ksoftirqd/311:42:163
82624199491,13cyclictest37-21ksoftirqd/310:43:523
82623799496,6cyclictest30-21ksoftirqd/209:01:152
82623799495,7cyclictest30-21ksoftirqd/210:26:312
82623799495,7cyclictest30-21ksoftirqd/210:26:312
826237994936,10cyclictest878427-21ssh10:46:362
826237994910,7cyclictest30-21ksoftirqd/209:22:122
826237994910,11cyclictest0-21swapper/211:27:192
82622799493,43cyclictest3467602-21systemd-journal12:05:000
826227994933,12cyclictest1-21systemd12:00:010
826227994921,13cyclictest848167-21ssh09:42:470
82624199486,9cyclictest37-21ksoftirqd/312:39:433
82624199484,8cyclictest37-21ksoftirqd/312:26:103
826241994815,7cyclictest37-21ksoftirqd/309:59:223
826241994812,7cyclictest0-21swapper/310:13:483
826241994810,32cyclictest831601-21cron08:55:003
82623799489,8cyclictest30-21ksoftirqd/211:46:272
82623799482,11cyclictest826784-21sshd07:20:022
82623799482,11cyclictest826784-21sshd07:20:022
826237994813,7cyclictest30-21ksoftirqd/209:40:362
826232994829,14cyclictest1-21systemd12:30:011
826227994839,7cyclictest12-21ksoftirqd/011:32:180
826227994832,12cyclictest827703-21cron07:40:000
82622799482,14cyclictest929190-21sshd12:34:150
82624199476,5cyclictest832403-21diskmemload11:58:383
826241994732,11cyclictest3467602-21systemd-journal08:44:023
82624199472,11cyclictest832403-21diskmemload10:48:573
82624199471,13cyclictest0-21swapper/311:23:283
826241994710,9cyclictest0-21swapper/310:31:583
826241994710,19cyclictest0-21swapper/311:10:563
826237994733,9cyclictest275-21dbus-daemon07:45:002
826237994727,15cyclictest830316-21cron08:30:002
82622799472,38cyclictest863414-21latency_hist10:15:010
82624199469,7cyclictest0-21swapper/311:26:173
82624199466,8cyclictest37-21ksoftirqd/311:55:013
82624199463,13cyclictest0-21swapper/310:01:493
826241994631,12cyclictest827810-21cat07:40:013
82623799468,7cyclictest30-21ksoftirqd/209:00:012
82623799468,7cyclictest30-21ksoftirqd/209:00:012
82623799465,5cyclictest131rcu_preempt08:23:152
82623799465,5cyclictest131rcu_preempt08:23:152
82623799464,6cyclictest131rcu_preempt09:35:012
826237994612,8cyclictest30-21ksoftirqd/212:07:192
826232994630,12cyclictest23-21ksoftirqd/112:40:001
826232994627,13cyclictest1-21systemd11:00:011
826232994626,14cyclictest3467602-21systemd-journal08:35:001
826227994617,13cyclictest884412-21ssh10:59:370
82622799461,3cyclictest131rcu_preempt11:47:430
82624199455,8cyclictest37-21ksoftirqd/307:15:003
826241994530,11cyclictest826904-21sed07:20:033
826241994530,11cyclictest826904-21sed07:20:033
82623799455,6cyclictest30-21ksoftirqd/210:07:302
826237994523,15cyclictest275-21dbus-daemon07:30:012
826232994530,11cyclictest3467602-21systemd-journal10:40:001
82622799452,38cyclictest827464-21munin-run07:35:000
82622799452,13cyclictest909115-21ssh11:51:250
82624199445,8cyclictest37-21ksoftirqd/307:27:163
826241994427,12cyclictest830836-21cat08:40:003
826241994411,6cyclictest0-21swapper/309:51:403
82623799446,8cyclictest30-21ksoftirqd/211:58:232
826237994429,11cyclictest830812-21sshd08:38:152
826237994426,15cyclictest827446-21sshd07:34:162
826232994433,9cyclictest23-21ksoftirqd/109:14:381
826232994432,8cyclictest3467602-21systemd-journal08:55:151
826232994432,8cyclictest3467602-21systemd-journal08:55:151
826227994437,4cyclictest16950irq/224-800000007:55:000
82622799441,39cyclictest150-21pr/ttyS208:31:160
82622799441,39cyclictest0-21swapper/007:15:000
82624199436,7cyclictest37-21ksoftirqd/307:50:033
82624199431,8cyclictest0-21swapper/308:47:153
826241994311,7cyclictest0-21swapper/307:50:003
826237994329,10cyclictest3467602-21systemd-journal08:35:012
82623299434,7cyclictest23-21ksoftirqd/111:31:291
826232994331,9cyclictest832490-21latency_hist09:10:021
826232994330,10cyclictest3467602-21systemd-journal07:15:021
826232994330,10cyclictest3467602-21systemd-journal07:15:021
826232994329,11cyclictest1-21systemd09:40:011
826232994329,10cyclictest3467602-21systemd-journal07:26:161
82623299432,7cyclictest0-21swapper/111:18:031
826232994322,14cyclictest275-21dbus-daemon09:05:001
82623299431,4cyclictest131rcu_preempt11:26:451
826227994336,4cyclictest16950irq/224-800000008:15:010
82622799432,6cyclictest830874-21unin-run08:40:000
826227994310,23cyclictest826229-21cat07:10:000
826232994230,7cyclictest309-21in:imuxsock11:50:011
826232994228,11cyclictest830054-21sshd08:22:151
826232994228,11cyclictest830054-21sshd08:22:151
82623299422,3cyclictest131rcu_preempt07:10:021
82623299421,3cyclictest131rcu_preempt10:27:161
82623299421,3cyclictest131rcu_preempt10:27:161
826227994227,11cyclictest12-21ksoftirqd/008:55:010
826241994123,12cyclictest275-21dbus-daemon08:30:013
826237994116,21cyclictest275-21dbus-daemon08:15:012
826232994129,9cyclictest23-21ksoftirqd/110:11:191
826232994126,11cyclictest23-21ksoftirqd/109:30:181
826232994126,10cyclictest275-21dbus-daemon09:25:011
82623299412,3cyclictest131rcu_preempt10:20:401
826232994122,15cyclictest275-21dbus-daemon09:30:011
82623299411,4cyclictest131rcu_preempt10:05:471
82622799412,5cyclictest1-21systemd09:10:010
82624199406,5cyclictest131rcu_preempt07:33:153
82624199404,8cyclictest37-21ksoftirqd/308:17:433
82624199402,7cyclictest829286-21munin-run08:10:013
82623799406,7cyclictest30-21ksoftirqd/207:11:152
82623799406,4cyclictest131rcu_preempt08:17:002
826232994028,9cyclictest23-21ksoftirqd/109:40:101
826232994025,11cyclictest831099-21cron08:44:591
826232994025,11cyclictest23-21ksoftirqd/110:46:131
826232994024,11cyclictest3467602-21systemd-journal07:57:321
82623299401,4cyclictest131rcu_preempt12:11:561
82623299401,4cyclictest131rcu_preempt11:10:021
826227994023,13cyclictest3467602-21systemd-journal09:04:590
82623799395,6cyclictest30-21ksoftirqd/207:24:152
826237993927,9cyclictest831341-21sshd08:48:142
826237993925,11cyclictest3467602-21systemd-journal08:00:012
826232993929,7cyclictest851521-21cat09:50:011
826232993926,9cyclictest924845-21modprobe12:25:011
826232993925,10cyclictest1-21systemd09:20:011
826232993925,10cyclictest1-21systemd09:20:011
82623299392,4cyclictest131rcu_preempt11:39:421
826232993924,11cyclictest3467602-21systemd-journal08:00:221
826232993923,11cyclictest0-21swapper/111:52:531
82624199384,7cyclictest37-21ksoftirqd/307:42:363
826241993817,16cyclictest48-21kcompactd009:00:113
82623799386,21cyclictest3467602-21systemd-journal07:35:052
82623299384,3cyclictest131rcu_preempt11:22:041
82623299383,4cyclictest131rcu_preempt11:57:421
826232993831,4cyclictest880200-21sh10:50:161
826232993828,7cyclictest890511-21sshd11:12:151
826232993827,9cyclictest23-21ksoftirqd/112:31:451
826232993825,10cyclictest23-21ksoftirqd/109:50:461
826232993821,12cyclictest1-21systemd07:55:011
826227993831,4cyclictest16950irq/224-800000008:00:000
826227993828,7cyclictest12-21ksoftirqd/008:44:140
826227993828,7cyclictest12-21ksoftirqd/007:25:020
826227993826,9cyclictest829271-21cron08:10:000
826241993722,10cyclictest275-21dbus-daemon08:05:013
82623799374,7cyclictest30-21ksoftirqd/208:02:152
826237993724,10cyclictest3467602-21systemd-journal08:55:002
826237993723,11cyclictest828226-21sshd07:48:152
82623299377,7cyclictest23-21ksoftirqd/108:15:351
82623299373,4cyclictest131rcu_preempt07:35:011
826232993726,8cyclictest23-21ksoftirqd/110:30:331
826232993724,10cyclictest23-21ksoftirqd/110:15:561
826232993724,10cyclictest23-21ksoftirqd/110:15:561
826232993724,10cyclictest23-21ksoftirqd/107:21:141
82623299372,3cyclictest131rcu_preempt11:01:201
826232993722,12cyclictest1-21systemd08:40:011
826232993710,5cyclictest131rcu_preempt08:10:021
82622799376,27cyclictest12-21ksoftirqd/008:30:010
826227993726,9cyclictest12-21ksoftirqd/007:45:020
826241993628,5cyclictest829742-21latency_hist08:15:033
82624199361,8cyclictest0-21swapper/307:25:003
82623799366,6cyclictest30-21ksoftirqd/209:07:232
826232993628,5cyclictest857162-21sh10:01:461
826232993625,6cyclictest832403-21diskmemload12:15:361
826232993624,10cyclictest23-21ksoftirqd/110:40:541
826227993623,9cyclictest309-21in:imuxsock08:25:010
826227993623,9cyclictest309-21in:imuxsock08:25:010
82624199354,6cyclictest37-21ksoftirqd/308:32:463
82623299355,4cyclictest131rcu_preempt07:50:021
826232993526,7cyclictest23-21ksoftirqd/109:56:151
826232993522,9cyclictest3467602-21systemd-journal07:15:011
82623299351,8cyclictest829528-21modprobe08:15:011
82624199345,7cyclictest37-21ksoftirqd/308:55:153
82624199345,7cyclictest37-21ksoftirqd/308:55:153
82623299342,28cyclictest48-21kcompactd008:50:121
826232993217,12cyclictest275-21dbus-daemon08:30:001
82623299313,8cyclictest23-21ksoftirqd/107:43:241
826232993017,10cyclictest23-21ksoftirqd/108:50:021
826241992922,4cyclictest826363-21latency_hist07:10:023
82623799278,16cyclictest826163-21latency_hist07:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional